Sep 01 01:51:37 devstack cinder-volume[75752]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 01:51:37 devstack cinder-volume[75752]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 01:51:37 devstack cinder-volume[75752]: we strongly recommend against using it for new projects. Sep 01 01:51:37 devstack cinder-volume[75752]: If you are already using Eventlet, we recommend migrating to a different Sep 01 01:51:37 devstack cinder-volume[75752]: framework. For more detail see Sep 01 01:51:37 devstack cinder-volume[75752]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 01:51:37 devstack cinder-volume[75752]: import eventlet # noqa Sep 01 01:51:40 devstack cinder-volume[75752]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75752) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:51:40 devstack cinder-volume[75752]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75752) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:51:40 devstack cinder-volume[75752]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75752) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:51:41 devstack cinder-volume[75752]: INFO dbcounter [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Registered counter for database cinder Sep 01 01:51:41 devstack cinder-volume[75752]: DEBUG oslo_db.sqlalchemy.engines [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75752) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:51:41 devstack cinder-volume[75752]: DEBUG dbcounter [-] [75752] Writer thread running {{(pid=75752) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:51:41 devstack cinder-volume[75752]: INFO cinder.rpc [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 01:51:41 devstack cinder-volume[75752]: INFO cinder.rpc [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 01:51:41 devstack cinder-volume[75752]: DEBUG oslo_db.sqlalchemy.engines [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75752) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:51:41 devstack cinder-volume[75752]: INFO cinder.volume.manager [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Determined volume DB was empty at startup. Sep 01 01:51:41 devstack cinder-volume[75752]: DEBUG cinder.volume.manager [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75752) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 01:51:41 devstack cinder-volume[75752]: INFO cinder.volume.manager [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 01 01:51:41 devstack cinder-volume[75752]: WARNING stevedore.named [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 01:51:41 devstack cinder-volume[75752]: WARNING castellan.key_manager [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:51:41 devstack cinder-volume[75752]: WARNING cinder.keymgr.conf_key_mgr [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:51:41 devstack cinder-volume[75752]: DEBUG cinder.volume.drivers.lvm [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75752) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 01 01:51:41 devstack cinder-volume[75752]: DEBUG oslo_concurrency.processutils [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_concurrency.processutils [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] CMD "cinder-rtstool verify" returned: 0 in 0.448s {{(pid=75752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_db.sqlalchemy.engines [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75752) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:51:42 devstack cinder-volume[75752]: INFO cinder.rpc [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 01 01:51:42 devstack cinder-volume[75752]: INFO cinder.rpc [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 01 01:51:42 devstack cinder-volume[75752]: WARNING stevedore.named [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 01:51:42 devstack cinder-volume[75752]: WARNING castellan.key_manager [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:51:42 devstack cinder-volume[75752]: INFO cinder.volume.manager [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_db.sqlalchemy.engines [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75752) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:51:42 devstack cinder-volume[75752]: INFO oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Starting 1 workers Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Started child 75911 {{(pid=75752) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Full set of CONF: {{(pid=75752) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] ******************************************************************************** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Configuration options gathered from: {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] ================================================================================ {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] allow_availability_zone_fallback = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] allow_compression_on_image_upload = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75911]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] allowed_direct_url_schemes = [] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] api_rate_limit = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] auth_strategy = keystone {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] az_cache_duration = 3600 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_availability_zone = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_host = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_name = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_stats_polling_interval = 60 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backup_api_class = cinder.backup.api.API {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backup_name_template = backup-%s {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backup_use_same_host = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backup_use_temp_snapshot = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] chap_password = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] chap_username = {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cinder_internal_tenant_project_id = 431bc600ccd44712842aa3a6fe1eedc4 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cinder_internal_tenant_user_id = 487034bb385a4e15905680b3854f2353 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cloned_volume_same_az = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cluster = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] compression_format = gzip {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] compute_api_class = cinder.compute.nova.API {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] config_dir = [] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] config_source = [] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] control_exchange = openstack {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] debug = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] default_availability_zone = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] default_group_type = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] default_volume_type = lvmdriver-1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] disk_geometry = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] driver_client_cert = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] driver_client_cert_key = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] driver_data_namespace = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] driver_ssl_cert_path = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] driver_ssl_cert_verify = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] driver_use_ssl = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] enable_force_upload = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] enable_new_services = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] enable_unsupported_driver = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] enabled_backends = ['lvmdriver-1'] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] enforce_multipath_for_image_xfer = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] filter_function = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] glance_api_insecure = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] glance_api_servers = ['http://192.168.122.25/image'] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] glance_api_ssl_compression = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] glance_ca_certificates_file = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] glance_catalog_info = image:glance:publicURL {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] glance_certfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] glance_keyfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] glance_num_retries = 3 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] glance_request_timeout = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] goodness_function = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] graceful_shutdown_timeout = 5 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] group_api_class = cinder.group.api.API {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] host = devstack {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] image_compress_on_upload = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] image_conversion_address_space_limit = 1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] image_conversion_cpu_limit = 60 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] image_conversion_disable = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] image_upload_use_cinder_backend = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] image_upload_use_internal_tenant = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] image_volume_cache_enabled = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] image_volume_cache_max_count = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] image_volume_cache_max_size_gb = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] init_host_max_objects_retrieval = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] instance_format = [instance: %(uuid)s] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] iscsi_target_flags = {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] iscsi_write_cache = on {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] iser_helper = tgtadm {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] iser_ip_address = 192.168.122.25 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] iser_port = 3260 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] log_color = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] log_config_append = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] log_dir = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] log_file = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] log_options = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] log_rotate_interval = 1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] log_rotate_interval_type = days {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] log_rotation_type = none {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] max_age = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] max_logfile_count = 30 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] max_logfile_size_mb = 200 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] max_over_subscription_ratio = 20.0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] message_reap_interval = 86400 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] message_ttl = 2592000 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] migration_create_volume_timeout_secs = 300 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] monkey_patch = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] monkey_patch_modules = [] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] my_ip = 192.168.122.25 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] no_snapshot_gb_quota = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] num_iser_scan_tries = 3 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] num_shell_tries = 3 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75911]: INFO cinder.volume.manager [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] num_volume_device_scan_tries = 3 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] nvmeof_conn_info_version = 1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] nvmet_ns_id = 10 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] nvmet_port_id = 1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] osapi_max_limit = 1000 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] osapi_volume_ext_list = [] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] osapi_volume_listen = 0.0.0.0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] osapi_volume_listen_port = 8776 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] osapi_volume_use_ssl = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] osapi_volume_workers = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] per_volume_size_limit = -1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] periodic_fuzzy_delay = 60 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] periodic_interval = 60 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] project_id_regex = [0-9a-f\-]+ {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] public_endpoint = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] publish_errors = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] quota_backup_gigabytes = 1000 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] quota_backups = 10 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] quota_gigabytes = 1000 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] quota_groups = 10 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] quota_snapshots = 10 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] quota_volumes = 10 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] rate_limit_burst = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] rate_limit_except_level = CRITICAL {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] rate_limit_interval = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] reinit_driver_count = 3 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] replication_device = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] report_discard_supported = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] report_interval = 120 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] reservation_clean_interval = 86400 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] reservation_expire = 86400 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] reserved_image_namespaces = [] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] reserved_percentage = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] rpc_response_timeout = 120 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] run_external_periodic_tasks = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] scst_target_driver = iscsi {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] scst_target_iqn_name = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] service_down_time = 720 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] shell_completion = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] snapshot_name_template = snapshot-%s {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] snapshot_same_host = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] split_loggers = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] state_path = /opt/stack/data/cinder {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] storage_availability_zone = nova {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] storage_protocol = iSCSI {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] syslog_log_facility = LOG_USER {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] target_helper = lioadm {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] target_ip_address = 192.168.122.25 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] target_port = 3260 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] target_protocol = iscsi {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] target_secondary_ip_addresses = [] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] trace_flags = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] transfer_api_class = cinder.transfer.api.API {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] transport_url = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] until_refresh = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] use_chap_auth = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] use_default_quota_class = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] use_journal = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] use_json = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] use_multipath_for_image_xfer = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] use_stderr = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] use_syslog = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] verify_glance_signatures = enabled {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] volume_api_class = cinder.volume.api.API {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] volume_backend_name = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] volume_clear = zero {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] volume_clear_ionice = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] volume_clear_size = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] volume_copy_bps_limit = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] volume_dd_blocksize = 1M {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] volume_name_template = volume-%s {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] volume_service_inithost_offload = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] volume_usage_audit_period = month {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] zoning_mode = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_concurrency.disable_process_locking = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.auth_section = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.auth_type = password {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.auth_version = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.cache = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.certfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.delay_auth_decision = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.http_connect_timeout = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.include_service_catalog = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.insecure = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.interface = public {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.keyfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.memcache_password = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.memcache_username = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.region_name = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.service_token_roles_required = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.service_type = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.token_cache_time = 300 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.25/identity {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.backend = dogpile.cache.null {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.backend_argument = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.backend_expiration_time = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.config_prefix = cache.oslo {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.debug_cache_backend = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.enable_retry_client = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.enable_socket_keepalive = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.enabled = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.expiration_time = 600 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.hashclient_retry_attempts = 2 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.memcache_dead_retry = 300 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.memcache_pool_maxsize = 10 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.memcache_sasl_enabled = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.password = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.proxies = [] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.redis_db = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.redis_sentinel_service_name = mymaster {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.redis_server = localhost:6379 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.retry_attempts = 2 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.retry_delay = 0.0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.socket_keepalive_count = 1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.socket_keepalive_idle = 1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.socket_keepalive_interval = 1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.socket_timeout = 1.0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.tls_allowed_ciphers = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.tls_cafile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.tls_certfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.tls_enabled = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.tls_keyfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cache.username = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] coordination.backend_url = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] database.asyncio_connection = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] database.asyncio_slave_connection = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] database.backend = sqlalchemy {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] database.connection = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] database.connection_debug = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] database.connection_parameters = {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] database.connection_recycle_time = 3600 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] database.connection_trace = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] database.db_inc_retry_interval = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] database.db_max_retries = 20 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] database.db_max_retry_interval = 10 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] database.db_retry_interval = 1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] database.max_overflow = 50 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] database.max_pool_size = 5 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] database.max_retries = 10 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] database.mysql_wsrep_sync_wait = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] database.pool_timeout = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] database.retry_interval = 10 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] database.slave_connection = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] database.sqlite_synchronous = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] database.synchronous_reader = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] database.use_db_reconnect = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_tracing.insecure = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] profiler.connection_string = messaging:// {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] profiler.enabled = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] profiler.es_doc_type = notification {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] profiler.es_scroll_size = 10000 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] profiler.es_scroll_time = 2m {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] profiler.filter_error_trace = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] profiler.hmac_keys = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] profiler.sentinel_service_name = mymaster {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] profiler.socket_timeout = 0.1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] profiler.trace_requests = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] profiler.trace_sqlalchemy = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] profiler_jaeger.process_tags = {} {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] profiler_jaeger.service_name_prefix = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] profiler_otlp.service_name_prefix = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_policy.enforce_new_defaults = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_policy.policy_default_rule = default {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_policy.policy_file = policy.yaml {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_policy.remote_timeout = 60.0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] privsep_osbrick.group = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] privsep_osbrick.helper_command = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] privsep_osbrick.user = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cinder_sys_admin.group = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cinder_sys_admin.helper_command = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] cinder_sys_admin.user = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] service_user.auth_section = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] service_user.auth_type = password {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] service_user.cafile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] service_user.certfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] service_user.collect_timing = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] service_user.insecure = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] service_user.keyfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] service_user.send_service_user_token = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] service_user.split_loggers = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] service_user.timeout = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] glance.auth_section = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] glance.auth_type = password {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] glance.certfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] glance.collect_timing = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] glance.insecure = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] glance.keyfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] glance.region_name = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] glance.split_loggers = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] glance.timeout = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.backend_availability_zone = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.chap_password = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.chap_username = {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.disk_geometry = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.driver_client_cert = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.driver_client_cert_key = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.driver_data_namespace = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.driver_use_ssl = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.enable_unsupported_driver = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.extra_capabilities = {} {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.filter_function = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.goodness_function = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.iscsi_target_flags = {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack sudo[75915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 01 01:51:42 devstack sudo[75915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.iscsi_write_cache = on {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.iser_helper = tgtadm {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.iser_ip_address = 192.168.122.25 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.iser_port = 3260 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.lvm_mirrors = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.lvm_share_target = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.lvm_type = auto {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.num_shell_tries = 3 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.nvmet_port_id = 1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.replication_device = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.report_discard_supported = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.reserved_percentage = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.scst_target_driver = iscsi {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.scst_target_iqn_name = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.storage_protocol = iSCSI {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.target_helper = tgtadm {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.target_ip_address = 192.168.122.25 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.target_port = 3260 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.target_protocol = iscsi {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.trace_flags = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.unique_fqdn_network = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.use_chap_auth = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.volume_backend_name = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.volume_clear = zero {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.volume_clear_ionice = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.volume_clear_size = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.volume_group = cinder-volumes {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_reports.file_event_handler = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_reports.log_dir = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.backend_availability_zone = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.backend_host = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.chap_password = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.chap_username = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.chiscsi_conf = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.disk_geometry = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.driver_client_cert = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.driver_data_namespace = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.driver_use_ssl = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.extra_capabilities = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.filter_function = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.goodness_function = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.iser_helper = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.iser_ip_address = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.iser_port = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.iser_target_prefix = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.lvm_conf_file = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.lvm_mirrors = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.lvm_share_target = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.lvm_type = auto {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.num_shell_tries = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.nvmet_port_id = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.replication_device = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.report_discard_supported = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.reserved_percentage = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.scst_target_driver = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.storage_protocol = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.target_helper = lioadm {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.target_ip_address = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.target_port = 3260 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.target_protocol = iscsi {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.trace_flags = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.use_chap_auth = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.volume_clear = zero {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.volume_clear_size = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] lvmdriver-1.volumes_dir = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.ssl = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.ssl_version = {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_notifications.driver = [] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_notifications.retry = -1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] oslo_messaging_notifications.transport_url = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] key_manager.fixed_key = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] barbican.barbican_api_version = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] barbican.barbican_endpoint = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] barbican.barbican_endpoint_type = public {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] barbican.barbican_region_name = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] barbican.cafile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] barbican.certfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] barbican.collect_timing = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] barbican.insecure = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] barbican.keyfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] barbican.number_of_retries = 60 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] barbican.retry_delay = 1 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] barbican.send_service_user_token = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] barbican.split_loggers = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] barbican.timeout = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] barbican.verify_ssl = True {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] barbican.verify_ssl_path = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] barbican_service_user.auth_section = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] barbican_service_user.auth_type = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] barbican_service_user.cafile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] barbican_service_user.certfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] barbican_service_user.collect_timing = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] barbican_service_user.insecure = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] barbican_service_user.keyfile = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] barbican_service_user.split_loggers = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] barbican_service_user.timeout = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] vault.approle_role_id = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] vault.approle_secret_id = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] vault.auth_method = approle {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] vault.auth_path = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] vault.kv_mountpoint = secret {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] vault.kv_path = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] vault.kv_version = 2 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] vault.namespace = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] vault.root_token_id = **** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] vault.ssl_ca_crt_file = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] vault.timeout = 60.0 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] vault.token_file = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] vault.token_role = None {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] vault.use_ssl = False {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:51:42 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] ******************************************************************************** {{(pid=75752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 01:51:42 devstack sudo[75915]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:42 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.338s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:42 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:42 devstack sudo[75918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:51:42 devstack sudo[75918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:43 devstack sudo[75918]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:43 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.327s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:43 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:51:43 devstack cinder-volume[75911]: INFO cinder.brick.local_dev.lvm [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 01 01:51:43 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:43 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:43 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:43 devstack sudo[76039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:51:43 devstack sudo[76039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:43 devstack sudo[76039]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:43 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.339s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:43 devstack cinder-volume[75911]: DEBUG cinder.brick.local_dev.lvm [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75911) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 01 01:51:43 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:43 devstack sudo[76134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:51:43 devstack sudo[76134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:44 devstack sudo[76134]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:44 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.559s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:44 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:44 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:44 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:44 devstack sudo[76351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:51:44 devstack sudo[76351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:44 devstack sudo[76351]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:44 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:44 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:44 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:44 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:44 devstack sudo[76449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 01 01:51:44 devstack sudo[76449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:44 devstack sudo[76449]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:44 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.308s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:44 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:44 devstack sudo[76529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:51:44 devstack sudo[76529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:45 devstack sudo[76529]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:45 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:45 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:45 devstack sudo[76536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:51:45 devstack sudo[76536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:45 devstack sudo[76536]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:45 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:45 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:45 devstack sudo[76616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:51:45 devstack sudo[76616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:45 devstack sudo[76616]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:45 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:45 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:45 devstack sudo[76623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:51:45 devstack sudo[76623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:45 devstack sudo[76623]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:45 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.321s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:45 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:45 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:45 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:45 devstack sudo[76709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:51:45 devstack sudo[76709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:46 devstack sudo[76709]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:46 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:46 devstack cinder-volume[75911]: INFO cinder.volume.drivers.lvm [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 01 01:51:46 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:46 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:46 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:46 devstack sudo[76713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:51:46 devstack sudo[76713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:46 devstack sudo[76713]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:46 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.305s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:46 devstack cinder-volume[75911]: DEBUG cinder.volume.drivers.lvm [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Updating volume stats {{(pid=75911) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:51:46 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:46 devstack sudo[76716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:51:46 devstack sudo[76716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:46 devstack sudo[76716]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:46 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:46 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:46 devstack sudo[76725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:51:46 devstack sudo[76725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:47 devstack sudo[76725]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:47 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:47 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:47 devstack sudo[76728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:51:47 devstack sudo[76728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:47 devstack sudo[76728]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:47 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:47 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:47 devstack sudo[76731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:51:47 devstack sudo[76731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:47 devstack sudo[76731]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:47 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:47 devstack cinder-volume[75911]: INFO cinder.volume.driver [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Driver hasn't implemented _init_vendor_properties() Sep 01 01:51:47 devstack cinder-volume[75911]: DEBUG cinder.volume.driver [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75911) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 01:51:47 devstack cinder-volume[75911]: DEBUG oslo_db.sqlalchemy.engines [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75911) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:51:47 devstack cinder-volume[75911]: DEBUG dbcounter [-] [75911] Writer thread running {{(pid=75911) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:51:47 devstack cinder-volume[75911]: DEBUG cinder.db.api [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Building query based on filter {{(pid=75911) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 01:51:47 devstack cinder-volume[75911]: DEBUG cinder.image.image_utils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75911) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 01:51:47 devstack cinder-volume[75911]: INFO cinder.keymgr.migration [None req-aed4e2b2-88b6-4f83-a99e-a951fb9f32a2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 01:51:47 devstack cinder-volume[75911]: DEBUG cinder.volume.drivers.lvm [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Updating volume stats {{(pid=75911) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:51:47 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:47 devstack sudo[76735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:51:47 devstack sudo[76735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:48 devstack sudo[76735]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:48 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:48 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:48 devstack sudo[76739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:51:48 devstack sudo[76739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:48 devstack sudo[76739]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:48 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:48 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:48 devstack sudo[76743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:51:48 devstack sudo[76743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:48 devstack sudo[76743]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:48 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:48 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:48 devstack sudo[76746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:51:48 devstack sudo[76746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:48 devstack sudo[76746]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:48 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:48 devstack cinder-volume[75911]: DEBUG cinder.manager [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Notifying Schedulers of capabilities ... {{(pid=75911) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:51:48 devstack cinder-volume[75911]: INFO cinder.volume.manager [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Driver initialization completed successfully. Sep 01 01:51:48 devstack cinder-volume[75911]: INFO cinder.manager [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Initiating service 2 cleanup Sep 01 01:51:48 devstack cinder-volume[75911]: INFO cinder.manager [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Service 2 cleanup completed. Sep 01 01:51:48 devstack cinder-volume[75911]: DEBUG cinder.service [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Creating RPC server for service cinder-volume {{(pid=75911) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 01:51:48 devstack cinder-volume[75911]: DEBUG cinder.service [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75911) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 01:51:49 devstack cinder-volume[75911]: INFO cinder.volume.manager [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 01 01:51:49 devstack cinder-volume[75911]: DEBUG cinder.volume.drivers.lvm [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Updating volume stats {{(pid=75911) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:51:49 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:49 devstack sudo[76752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:51:49 devstack sudo[76752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:49 devstack sudo[76752]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:49 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:49 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:49 devstack sudo[76755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:51:49 devstack sudo[76755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:49 devstack sudo[76755]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:49 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:49 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:49 devstack sudo[76760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:51:49 devstack sudo[76760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:49 devstack sudo[76760]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:49 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:49 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:49 devstack sudo[76763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:51:49 devstack sudo[76763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:50 devstack sudo[76763]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:50 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:50 devstack cinder-volume[75911]: INFO cinder.volume.manager [None req-d6bd9479-3a3a-42d9-b91b-51199c1c7dff None None] Driver post RPC initialization completed successfully. Sep 01 01:51:52 devstack cinder-volume[75752]: DEBUG dbcounter [-] [75752] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75752) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:52:00 devstack cinder-volume[75911]: DEBUG dbcounter [-] [75911] Writing DB stats cinder:SELECT=4 {{(pid=75911) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:52:00 devstack cinder-volume[75911]: DEBUG dbcounter [-] [75911] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75911) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:52:22 devstack cinder-volume[75911]: DEBUG oslo_service.periodic_task [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] Running periodic task VolumeManager._thread_info {{(pid=75911) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:52:22 devstack cinder-volume[75911]: DEBUG cinder.volume.manager [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] thread count: 6 {{(pid=75911) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:52:22 devstack cinder-volume[75911]: DEBUG cinder.volume.manager [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] thread info: [<_MainThread(MainThread, started 128015638921344)>, , , , , ] {{(pid=75911) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:53:22 devstack cinder-volume[75911]: DEBUG oslo_service.periodic_task [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75911) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:53:22 devstack cinder-volume[75911]: DEBUG cinder.volume.drivers.lvm [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] Updating volume stats {{(pid=75911) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:53:22 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:22 devstack sudo[80057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:53:22 devstack sudo[80057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:22 devstack sudo[80057]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:22 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:22 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:22 devstack sudo[80287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:53:22 devstack sudo[80287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:22 devstack sudo[80287]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:22 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:22 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:22 devstack sudo[80477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:53:22 devstack sudo[80477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:22 devstack sudo[80477]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:22 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:22 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:22 devstack sudo[80640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:53:22 devstack sudo[80640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:23 devstack sudo[80640]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:23 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:23 devstack cinder-volume[75911]: DEBUG cinder.manager [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] Notifying Schedulers of capabilities ... {{(pid=75911) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:53:23 devstack cinder-volume[75911]: DEBUG oslo_service.periodic_task [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] Running periodic task VolumeManager._thread_info {{(pid=75911) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:53:23 devstack cinder-volume[75911]: DEBUG cinder.volume.manager [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] thread count: 6 {{(pid=75911) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:53:23 devstack cinder-volume[75911]: DEBUG cinder.volume.manager [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] thread info: [<_MainThread(MainThread, started 128015638921344)>, , , , , ] {{(pid=75911) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:54:00 devstack cinder-volume[75911]: DEBUG dbcounter [-] [75911] Writing DB stats cinder:SELECT=1 {{(pid=75911) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:54:00 devstack cinder-volume[75911]: DEBUG dbcounter [-] [75911] Writing DB stats cinder:UPDATE=1 {{(pid=75911) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:54:22 devstack cinder-volume[75911]: DEBUG oslo_service.periodic_task [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75911) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:54:22 devstack cinder-volume[75911]: DEBUG cinder.volume.drivers.lvm [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] Updating volume stats {{(pid=75911) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:54:22 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:22 devstack sudo[83259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:54:22 devstack sudo[83259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:22 devstack sudo[83259]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:22 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:22 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:22 devstack sudo[83285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:54:22 devstack sudo[83285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:22 devstack sudo[83285]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:22 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:22 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:22 devstack sudo[83299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:54:22 devstack sudo[83299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:22 devstack sudo[83299]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:22 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:22 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:22 devstack sudo[83307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:54:22 devstack sudo[83307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:23 devstack sudo[83307]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:23 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:23 devstack cinder-volume[75911]: DEBUG cinder.manager [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] Notifying Schedulers of capabilities ... {{(pid=75911) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:54:23 devstack cinder-volume[75911]: DEBUG oslo_service.periodic_task [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] Running periodic task VolumeManager._thread_info {{(pid=75911) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:54:23 devstack cinder-volume[75911]: DEBUG cinder.volume.manager [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] thread count: 6 {{(pid=75911) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:54:23 devstack cinder-volume[75911]: DEBUG cinder.volume.manager [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] thread info: [<_MainThread(MainThread, started 128015638921344)>, , , , , ] {{(pid=75911) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:55:22 devstack cinder-volume[75911]: DEBUG oslo_service.periodic_task [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75911) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:55:22 devstack cinder-volume[75911]: DEBUG cinder.volume.drivers.lvm [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] Updating volume stats {{(pid=75911) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:55:22 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:22 devstack sudo[85286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:55:22 devstack sudo[85286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:22 devstack sudo[85286]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:22 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:22 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:22 devstack sudo[85293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:55:22 devstack sudo[85293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:22 devstack sudo[85293]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:22 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:22 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:22 devstack sudo[85296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:55:22 devstack sudo[85296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:23 devstack sudo[85296]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:23 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.289s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:23 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:23 devstack sudo[85300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:55:23 devstack sudo[85300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:23 devstack sudo[85300]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:23 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:23 devstack cinder-volume[75911]: DEBUG cinder.manager [None req-e41e7edd-8cc0-46c3-9947-35b08fc81578 None None] Notifying Schedulers of capabilities ... {{(pid=75911) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:56:00 devstack cinder-volume[75911]: DEBUG dbcounter [-] [75911] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75911) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:56:11 devstack cinder-volume[75752]: INFO oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Caught SIGTERM, stopping children Sep 01 01:56:11 devstack cinder-volume[75752]: DEBUG oslo_concurrency.lockutils [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Acquiring lock "singleton_lock" {{(pid=75752) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:56:11 devstack cinder-volume[75752]: DEBUG oslo_concurrency.lockutils [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Acquired lock "singleton_lock" {{(pid=75752) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:56:11 devstack cinder-volume[75752]: DEBUG oslo_concurrency.lockutils [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Releasing lock "singleton_lock" {{(pid=75752) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:56:11 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Stop services. {{(pid=75752) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 01 01:56:11 devstack cinder-volume[75752]: DEBUG oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Killing children. {{(pid=75752) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 01 01:56:11 devstack cinder-volume[75752]: INFO oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Waiting on 1 children to exit Sep 01 01:56:14 devstack cinder-volume[75911]: DEBUG oslo_concurrency.lockutils [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Acquiring lock "singleton_lock" {{(pid=75911) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:56:14 devstack cinder-volume[75911]: DEBUG oslo_concurrency.lockutils [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Acquired lock "singleton_lock" {{(pid=75911) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:56:14 devstack cinder-volume[75911]: DEBUG oslo_concurrency.lockutils [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Releasing lock "singleton_lock" {{(pid=75911) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:56:14 devstack cinder-volume[75911]: WARNING amqp [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 01:56:14 devstack cinder-volume[75911]: WARNING amqp [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 01:56:14 devstack cinder-volume[75752]: INFO oslo_service.backend._eventlet.service [None req-f577dc0e-4f43-4bc6-be72-6e88d7e9600b None None] Child 75911 exited with status 0 Sep 01 01:56:14 devstack cinder-volume[86341]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 01:56:14 devstack cinder-volume[86341]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 01:56:14 devstack cinder-volume[86341]: we strongly recommend against using it for new projects. Sep 01 01:56:14 devstack cinder-volume[86341]: If you are already using Eventlet, we recommend migrating to a different Sep 01 01:56:14 devstack cinder-volume[86341]: framework. For more detail see Sep 01 01:56:14 devstack cinder-volume[86341]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 01:56:14 devstack cinder-volume[86341]: import eventlet # noqa Sep 01 01:56:16 devstack cinder-volume[86341]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86341) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:56:16 devstack cinder-volume[86341]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86341) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:56:16 devstack cinder-volume[86341]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86341) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:56:17 devstack cinder-volume[86341]: INFO dbcounter [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] Registered counter for database cinder Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_db.sqlalchemy.engines [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86341) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG dbcounter [-] [86341] Writer thread running {{(pid=86341) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:56:17 devstack cinder-volume[86341]: INFO cinder.rpc [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 01:56:17 devstack cinder-volume[86341]: INFO cinder.rpc [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_db.sqlalchemy.engines [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86341) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:56:17 devstack cinder-volume[86341]: INFO cinder.volume.manager [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] Determined volume DB was empty at startup. Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG cinder.volume.manager [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86341) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 01:56:17 devstack cinder-volume[86341]: INFO cinder.volume.manager [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 01 01:56:17 devstack cinder-volume[86341]: WARNING stevedore.named [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 01:56:17 devstack cinder-volume[86341]: WARNING castellan.key_manager [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:56:17 devstack cinder-volume[86341]: WARNING cinder.keymgr.conf_key_mgr [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:56:17 devstack cinder-volume[86341]: INFO cinder.volume.manager [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_db.sqlalchemy.engines [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86341) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:56:17 devstack cinder-volume[86341]: INFO oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] Starting 1 workers Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] Started child 86558 {{(pid=86341) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] Full set of CONF: {{(pid=86341) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] ******************************************************************************** {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] Configuration options gathered from: {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] ================================================================================ {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] allow_availability_zone_fallback = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] allow_compression_on_image_upload = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] allowed_direct_url_schemes = [] {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] api_rate_limit = True {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] auth_strategy = keystone {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_availability_zone = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_host = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_name = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_stats_polling_interval = 60 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backup_api_class = cinder.backup.api.API {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backup_name_template = backup-%s {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backup_use_same_host = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backup_use_temp_snapshot = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] chap_password = **** {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] chap_username = {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cinder_internal_tenant_project_id = 431bc600ccd44712842aa3a6fe1eedc4 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cinder_internal_tenant_user_id = 487034bb385a4e15905680b3854f2353 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cluster = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] compression_format = gzip {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] compute_api_class = cinder.compute.nova.API {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] config_dir = [] {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] config_source = [] {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] control_exchange = openstack {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] debug = True {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86558]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] default_availability_zone = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] default_group_type = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] default_volume_type = QuobyteHD {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] disk_geometry = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] driver_client_cert = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] driver_client_cert_key = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] driver_data_namespace = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] driver_ssl_cert_path = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] driver_ssl_cert_verify = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] driver_use_ssl = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] enable_new_services = True {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] enable_unsupported_driver = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] enabled_backends = ['QuobyteHD'] {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] enforce_multipath_for_image_xfer = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] filter_function = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] glance_api_insecure = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] glance_api_servers = ['http://192.168.122.25/image'] {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] glance_api_ssl_compression = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] glance_ca_certificates_file = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] glance_catalog_info = image:glance:publicURL {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] glance_certfile = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] glance_keyfile = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] glance_num_retries = 3 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] glance_request_timeout = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] goodness_function = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] graceful_shutdown_timeout = 5 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] group_api_class = cinder.group.api.API {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] host = devstack {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] image_compress_on_upload = True {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] image_conversion_address_space_limit = 1 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] image_conversion_cpu_limit = 60 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] image_conversion_disable = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] image_upload_use_cinder_backend = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] image_upload_use_internal_tenant = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] image_volume_cache_enabled = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] image_volume_cache_max_count = 0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] image_volume_cache_max_size_gb = 0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] init_host_max_objects_retrieval = 0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] instance_format = [instance: %(uuid)s] {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] iscsi_target_flags = {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] iscsi_write_cache = on {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] iser_helper = tgtadm {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] iser_ip_address = 192.168.122.25 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] iser_port = 3260 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] log_color = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] log_config_append = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] log_dir = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] log_file = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] log_options = True {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] log_rotate_interval = 1 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] log_rotate_interval_type = days {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] log_rotation_type = none {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] max_age = 0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] max_logfile_count = 30 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] max_logfile_size_mb = 200 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] max_over_subscription_ratio = 20.0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] message_reap_interval = 86400 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] message_ttl = 2592000 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] migration_create_volume_timeout_secs = 300 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] monkey_patch = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] monkey_patch_modules = [] {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] my_ip = 192.168.122.25 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] no_snapshot_gb_quota = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] num_iser_scan_tries = 3 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] num_shell_tries = 3 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] num_volume_device_scan_tries = 3 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] nvmeof_conn_info_version = 1 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] nvmet_ns_id = 10 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] nvmet_port_id = 1 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] osapi_max_limit = 1000 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] osapi_volume_ext_list = [] {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] osapi_volume_listen_port = 8776 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] osapi_volume_use_ssl = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] osapi_volume_workers = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] per_volume_size_limit = -1 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] periodic_fuzzy_delay = 60 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] periodic_interval = 60 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] public_endpoint = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] publish_errors = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] quota_backup_gigabytes = 1000 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] quota_backups = 10 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] quota_gigabytes = 1000 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] quota_groups = 10 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] quota_snapshots = 10 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] quota_volumes = 10 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] rate_limit_burst = 0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] rate_limit_except_level = CRITICAL {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] rate_limit_interval = 0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] reinit_driver_count = 3 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] replication_device = **** {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] report_discard_supported = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] report_interval = 120 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] reservation_clean_interval = 86400 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] reservation_expire = 86400 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] reserved_image_namespaces = [] {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] reserved_percentage = 0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] rpc_response_timeout = 120 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] run_external_periodic_tasks = True {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] scst_target_driver = iscsi {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] scst_target_iqn_name = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] service_down_time = 720 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] shell_completion = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] snapshot_name_template = snapshot-%s {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] split_loggers = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] state_path = /opt/stack/data/cinder {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] storage_availability_zone = nova {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] storage_protocol = iSCSI {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] syslog_log_facility = LOG_USER {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] target_helper = lioadm {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] target_ip_address = 192.168.122.25 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] target_port = 3260 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86558]: INFO cinder.volume.manager [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Starting volume driver QuobyteDriver (1.2.1) Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86558]: DEBUG cinder.volume.drivers.remotefs [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86558) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] target_protocol = iscsi {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] target_secondary_ip_addresses = [] {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] trace_flags = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] transport_url = **** {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] until_refresh = 0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] use_chap_auth = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] use_default_quota_class = True {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] use_journal = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] use_json = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] use_multipath_for_image_xfer = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] use_stderr = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] use_syslog = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] verify_glance_signatures = enabled {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] volume_api_class = cinder.volume.api.API {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] volume_backend_name = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] volume_clear = zero {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] volume_clear_ionice = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] volume_clear_size = 0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] volume_copy_bps_limit = 0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] volume_dd_blocksize = 1M {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] volume_name_template = volume-%s {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] volume_service_inithost_offload = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] volume_usage_audit_period = month {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] zoning_mode = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_concurrency.disable_process_locking = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.auth_section = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.auth_type = password {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.auth_version = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.cache = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.certfile = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.include_service_catalog = True {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.insecure = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.interface = public {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.keyfile = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.memcache_password = **** {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.memcache_username = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.region_name = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.service_type = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.25/identity {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.backend = dogpile.cache.null {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.backend_argument = **** {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.backend_expiration_time = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.config_prefix = cache.oslo {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.debug_cache_backend = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.enable_retry_client = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.enable_socket_keepalive = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.enabled = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.expiration_time = 600 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.hashclient_retry_attempts = 2 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.memcache_dead_retry = 300 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.memcache_pool_maxsize = 10 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.memcache_sasl_enabled = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.password = **** {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.proxies = [] {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.redis_db = 0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86558]: DEBUG cinder.volume.drivers.quobyte [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86558) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 01 01:56:17 devstack cinder-volume[86558]: WARNING cinder.volume.drivers.quobyte [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 01 01:56:17 devstack cinder-volume[86558]: WARNING cinder.volume.drivers.quobyte [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86558]: DEBUG oslo_concurrency.processutils [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Running cmd (subprocess): mount.quobyte {{(pid=86558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.redis_server = localhost:6379 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.retry_attempts = 2 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.retry_delay = 0.0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.socket_keepalive_count = 1 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.socket_keepalive_idle = 1 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.socket_keepalive_interval = 1 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.socket_timeout = 1.0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.tls_allowed_ciphers = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.tls_cafile = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.tls_certfile = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.tls_enabled = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.tls_keyfile = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cache.username = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] coordination.backend_url = **** {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] database.asyncio_connection = **** {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] database.asyncio_slave_connection = **** {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] database.backend = sqlalchemy {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] database.connection = **** {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] database.connection_debug = 0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] database.connection_parameters = {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] database.connection_recycle_time = 3600 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] database.connection_trace = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] database.db_inc_retry_interval = True {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] database.db_max_retries = 20 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] database.db_max_retry_interval = 10 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] database.db_retry_interval = 1 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] database.max_overflow = 50 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] database.max_pool_size = 5 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] database.max_retries = 10 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] database.mysql_wsrep_sync_wait = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] database.pool_timeout = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] database.retry_interval = 10 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] database.slave_connection = **** {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] database.sqlite_synchronous = True {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] database.synchronous_reader = True {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] database.use_db_reconnect = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_tracing.insecure = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] profiler.connection_string = messaging:// {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] profiler.enabled = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] profiler.es_doc_type = notification {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] profiler.es_scroll_size = 10000 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] profiler.es_scroll_time = 2m {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] profiler.filter_error_trace = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] profiler.hmac_keys = **** {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] profiler.sentinel_service_name = mymaster {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] profiler.socket_timeout = 0.1 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] profiler.trace_requests = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] profiler.trace_sqlalchemy = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] profiler_jaeger.process_tags = {} {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] profiler_jaeger.service_name_prefix = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] profiler_otlp.service_name_prefix = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_policy.enforce_new_defaults = True {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_policy.policy_default_rule = default {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_policy.policy_file = policy.yaml {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] privsep_osbrick.group = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] privsep_osbrick.helper_command = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:17 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] privsep_osbrick.user = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cinder_sys_admin.group = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cinder_sys_admin.helper_command = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] cinder_sys_admin.user = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] service_user.auth_section = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] service_user.auth_type = password {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] service_user.cafile = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] service_user.certfile = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] service_user.collect_timing = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] service_user.insecure = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] service_user.keyfile = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] service_user.send_service_user_token = True {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] service_user.split_loggers = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] service_user.timeout = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] glance.auth_section = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] glance.auth_type = password {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] glance.certfile = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] glance.collect_timing = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] glance.insecure = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] glance.keyfile = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] glance.region_name = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] glance.split_loggers = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] glance.timeout = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.backend_availability_zone = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.chap_password = **** {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.chap_username = {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.disk_geometry = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.driver_client_cert = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.driver_client_cert_key = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.driver_data_namespace = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.driver_use_ssl = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.extra_capabilities = {} {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.filter_function = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.goodness_function = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.iscsi_target_flags = {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.iscsi_write_cache = on {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.iser_helper = tgtadm {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.iser_ip_address = 192.168.122.25 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.iser_port = 3260 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.nas_host = {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.nas_login = admin {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.nas_mount_options = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.nas_password = **** {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.nas_private_key = {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.nas_share_path = {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.num_shell_tries = 3 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.quobyte_volume_url = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.replication_device = **** {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.report_discard_supported = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.reserved_percentage = 0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.target_helper = tgtadm {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.target_ip_address = 192.168.122.25 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.target_port = 3260 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.target_protocol = iscsi {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.trace_flags = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.unique_fqdn_network = True {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.use_chap_auth = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.volume_backend_name = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.volume_clear = zero {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.volume_clear_ionice = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.volume_clear_size = 0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_reports.file_event_handler = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_reports.log_dir = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.backend_availability_zone = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.backend_host = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.chap_password = **** {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.chap_username = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.chiscsi_conf = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.disk_geometry = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.driver_client_cert = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.driver_data_namespace = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.driver_use_ssl = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.extra_capabilities = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.filter_function = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.goodness_function = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.iser_helper = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.iser_ip_address = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.iser_port = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.iser_target_prefix = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.nas_host = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.nas_login = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.nas_mount_options = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.nas_password = **** {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.nas_private_key = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.nas_share_path = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.nas_ssh_port = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.num_shell_tries = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.nvmet_port_id = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.replication_device = **** {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.report_discard_supported = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.reserved_percentage = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.scst_target_driver = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.storage_protocol = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.target_helper = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.target_ip_address = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.target_port = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.target_prefix = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.target_protocol = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.trace_flags = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.use_chap_auth = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.volume_clear = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.volume_clear_size = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] QuobyteHD.volumes_dir = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack quobyte-client[86559]: Reading configuration file: /etc/quobyte/client.cfg Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack quobyte-client[86559]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.ssl = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_notifications.driver = [] {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_notifications.retry = -1 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] key_manager.fixed_key = **** {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] barbican.barbican_api_version = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] barbican.barbican_endpoint = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] barbican.barbican_endpoint_type = public {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] barbican.barbican_region_name = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] barbican.cafile = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] barbican.certfile = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] barbican.collect_timing = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] barbican.insecure = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] barbican.keyfile = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] barbican.number_of_retries = 60 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] barbican.retry_delay = 1 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] barbican.send_service_user_token = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] barbican.split_loggers = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] barbican.timeout = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] barbican.verify_ssl = True {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] barbican.verify_ssl_path = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] barbican_service_user.auth_section = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] barbican_service_user.auth_type = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] barbican_service_user.cafile = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] barbican_service_user.certfile = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] barbican_service_user.collect_timing = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] barbican_service_user.insecure = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] barbican_service_user.keyfile = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] barbican_service_user.split_loggers = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] barbican_service_user.timeout = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] vault.approle_role_id = **** {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] vault.approle_secret_id = **** {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] vault.auth_method = approle {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] vault.auth_path = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] vault.kv_mountpoint = secret {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] vault.kv_path = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86558]: DEBUG oslo_concurrency.processutils [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] CMD "mount.quobyte" returned: 1 in 0.124s {{(pid=86558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] vault.kv_version = 2 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] vault.namespace = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86558]: DEBUG oslo_concurrency.lockutils [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] vault.root_token_id = **** {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] vault.ssl_ca_crt_file = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] vault.timeout = 60.0 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86558]: DEBUG oslo_concurrency.lockutils [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] vault.token_file = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] vault.token_role = None {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] vault.use_ssl = False {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86558]: DEBUG cinder.volume.drivers.quobyte [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=86558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:18 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] ******************************************************************************** {{(pid=86341) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 01:56:18 devstack cinder-volume[86558]: INFO cinder.volume.drivers.quobyte [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb ... Sep 01 01:56:18 devstack cinder-volume[86558]: DEBUG oslo_concurrency.processutils [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b -c /etc/quobyte/client-cinder.cfg {{(pid=86558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:18 devstack sudo[86560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b -c /etc/quobyte/client-cinder.cfg Sep 01 01:56:18 devstack sudo[86560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:18 devstack sudo[86560]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:18 devstack cinder-volume[86558]: DEBUG oslo_concurrency.processutils [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.424s {{(pid=86558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:18 devstack cinder-volume[86558]: INFO cinder.volume.drivers.quobyte [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb succeeded Sep 01 01:56:18 devstack cinder-volume[86558]: DEBUG cinder.volume.drivers.quobyte [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=86558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:56:18 devstack cinder-volume[86558]: DEBUG oslo_concurrency.lockutils [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.438s {{(pid=86558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:18 devstack cinder-volume[86558]: DEBUG oslo_concurrency.processutils [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=86558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:18 devstack sudo[86633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 01:56:18 devstack sudo[86633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:18 devstack sudo[86633]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:18 devstack cinder-volume[86558]: DEBUG oslo_concurrency.processutils [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.247s {{(pid=86558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:18 devstack cinder-volume[86558]: INFO cinder.volume.driver [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Driver hasn't implemented _init_vendor_properties() Sep 01 01:56:18 devstack cinder-volume[86558]: DEBUG cinder.volume.driver [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.0434684753418, 'free_capacity_gb': 1774.0434684753418, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86558) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 01:56:18 devstack cinder-volume[86558]: DEBUG oslo_db.sqlalchemy.engines [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86558) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:56:18 devstack cinder-volume[86558]: DEBUG dbcounter [-] [86558] Writer thread running {{(pid=86558) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:56:18 devstack cinder-volume[86558]: DEBUG cinder.db.api [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Building query based on filter {{(pid=86558) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 01:56:18 devstack cinder-volume[86558]: DEBUG cinder.image.image_utils [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86558) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 01:56:18 devstack cinder-volume[86558]: INFO cinder.keymgr.migration [None req-50351196-e175-47df-9930-0dc0b407a279 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 01:56:18 devstack cinder-volume[86558]: DEBUG oslo_concurrency.lockutils [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:18 devstack cinder-volume[86558]: DEBUG oslo_concurrency.lockutils [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:18 devstack cinder-volume[86558]: DEBUG cinder.volume.drivers.quobyte [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=86558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:56:18 devstack cinder-volume[86558]: DEBUG cinder.volume.drivers.quobyte [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=86558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:56:18 devstack cinder-volume[86558]: DEBUG oslo_concurrency.lockutils [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:18 devstack cinder-volume[86558]: DEBUG oslo_concurrency.processutils [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=86558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:18 devstack sudo[86636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 01:56:18 devstack sudo[86636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:19 devstack sudo[86636]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:19 devstack cinder-volume[86558]: DEBUG oslo_concurrency.processutils [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.240s {{(pid=86558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:19 devstack cinder-volume[86558]: DEBUG cinder.manager [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Notifying Schedulers of capabilities ... {{(pid=86558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:56:19 devstack cinder-volume[86558]: INFO cinder.volume.manager [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Driver initialization completed successfully. Sep 01 01:56:19 devstack cinder-volume[86558]: INFO cinder.manager [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Initiating service 3 cleanup Sep 01 01:56:19 devstack cinder-volume[86558]: INFO cinder.manager [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Service 3 cleanup completed. Sep 01 01:56:19 devstack cinder-volume[86558]: DEBUG cinder.service [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Creating RPC server for service cinder-volume {{(pid=86558) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 01:56:19 devstack cinder-volume[86558]: DEBUG cinder.service [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86558) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 01:56:19 devstack cinder-volume[86558]: INFO cinder.volume.manager [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 01 01:56:19 devstack cinder-volume[86558]: DEBUG oslo_concurrency.lockutils [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:19 devstack cinder-volume[86558]: DEBUG oslo_concurrency.lockutils [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:19 devstack cinder-volume[86558]: DEBUG cinder.volume.drivers.quobyte [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=86558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:56:19 devstack cinder-volume[86558]: DEBUG cinder.volume.drivers.quobyte [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=86558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:56:19 devstack cinder-volume[86558]: DEBUG oslo_concurrency.lockutils [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:19 devstack cinder-volume[86558]: DEBUG oslo_concurrency.processutils [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=86558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:19 devstack sudo[86639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 01:56:19 devstack sudo[86639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:19 devstack sudo[86639]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:19 devstack cinder-volume[86558]: DEBUG oslo_concurrency.processutils [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.238s {{(pid=86558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:19 devstack cinder-volume[86558]: INFO cinder.volume.manager [None req-920b567f-1923-49b1-93f6-fe252cef9bde None None] Driver post RPC initialization completed successfully. Sep 01 01:56:24 devstack cinder-volume[86558]: DEBUG oslo_concurrency.lockutils [None req-2c4feb20-8e06-433f-a0f8-d2febdb386fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:24 devstack cinder-volume[86558]: DEBUG oslo_concurrency.lockutils [None req-2c4feb20-8e06-433f-a0f8-d2febdb386fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:24 devstack cinder-volume[86558]: DEBUG cinder.volume.drivers.quobyte [None req-2c4feb20-8e06-433f-a0f8-d2febdb386fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=86558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:56:24 devstack cinder-volume[86558]: DEBUG cinder.volume.drivers.quobyte [None req-2c4feb20-8e06-433f-a0f8-d2febdb386fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=86558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:56:24 devstack cinder-volume[86558]: DEBUG oslo_concurrency.lockutils [None req-2c4feb20-8e06-433f-a0f8-d2febdb386fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86558) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:24 devstack cinder-volume[86558]: DEBUG oslo_concurrency.processutils [None req-2c4feb20-8e06-433f-a0f8-d2febdb386fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=86558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:24 devstack sudo[86770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 01:56:24 devstack sudo[86770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:24 devstack sudo[86770]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:24 devstack cinder-volume[86558]: DEBUG oslo_concurrency.processutils [None req-2c4feb20-8e06-433f-a0f8-d2febdb386fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.246s {{(pid=86558) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:24 devstack cinder-volume[86558]: DEBUG cinder.manager [None req-2c4feb20-8e06-433f-a0f8-d2febdb386fd None None] Notifying Schedulers of capabilities ... {{(pid=86558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:56:25 devstack cinder-volume[86341]: INFO oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] Caught SIGTERM, stopping children Sep 01 01:56:25 devstack cinder-volume[86341]: DEBUG oslo_concurrency.lockutils [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] Acquiring lock "singleton_lock" {{(pid=86341) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:56:25 devstack cinder-volume[86341]: DEBUG oslo_concurrency.lockutils [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] Acquired lock "singleton_lock" {{(pid=86341) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:56:25 devstack cinder-volume[86341]: DEBUG oslo_concurrency.lockutils [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] Releasing lock "singleton_lock" {{(pid=86341) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:56:25 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] Stop services. {{(pid=86341) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 01 01:56:25 devstack cinder-volume[86341]: DEBUG oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] Killing children. {{(pid=86341) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 01 01:56:25 devstack cinder-volume[86341]: INFO oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] Waiting on 1 children to exit Sep 01 01:56:27 devstack cinder-volume[86558]: DEBUG oslo_concurrency.lockutils [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] Acquiring lock "singleton_lock" {{(pid=86558) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:56:27 devstack cinder-volume[86558]: DEBUG oslo_concurrency.lockutils [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] Acquired lock "singleton_lock" {{(pid=86558) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:56:27 devstack cinder-volume[86558]: DEBUG oslo_concurrency.lockutils [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] Releasing lock "singleton_lock" {{(pid=86558) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:56:27 devstack cinder-volume[86558]: WARNING amqp [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 01:56:27 devstack cinder-volume[86558]: WARNING amqp [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 01:56:27 devstack cinder-volume[86341]: INFO oslo_service.backend._eventlet.service [None req-1ea97a30-4b52-405f-a35e-d26a09fe0603 None None] Child 86558 exited with status 0 Sep 01 01:56:28 devstack cinder-volume[86846]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 01:56:28 devstack cinder-volume[86846]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 01:56:28 devstack cinder-volume[86846]: we strongly recommend against using it for new projects. Sep 01 01:56:28 devstack cinder-volume[86846]: If you are already using Eventlet, we recommend migrating to a different Sep 01 01:56:28 devstack cinder-volume[86846]: framework. For more detail see Sep 01 01:56:28 devstack cinder-volume[86846]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 01:56:28 devstack cinder-volume[86846]: import eventlet # noqa Sep 01 01:56:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86846) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:56:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86846) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:56:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86846) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:56:31 devstack cinder-volume[86846]: INFO dbcounter [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] Registered counter for database cinder Sep 01 01:56:31 devstack cinder-volume[86846]: DEBUG oslo_db.sqlalchemy.engines [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86846) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writer thread running {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:56:32 devstack cinder-volume[86846]: INFO cinder.rpc [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 01:56:32 devstack cinder-volume[86846]: INFO cinder.rpc [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_db.sqlalchemy.engines [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86846) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:56:32 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] Determined volume DB was empty at startup. Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86846) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 01:56:32 devstack cinder-volume[86846]: WARNING stevedore.named [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 01:56:32 devstack cinder-volume[86846]: WARNING castellan.key_manager [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:56:32 devstack cinder-volume[86846]: WARNING cinder.keymgr.conf_key_mgr [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:56:32 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_db.sqlalchemy.engines [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86846) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:56:32 devstack cinder-volume[86846]: INFO oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] Starting 1 workers Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] Started child 87128 {{(pid=86846) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] Full set of CONF: {{(pid=86846) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] ******************************************************************************** {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] Configuration options gathered from: {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] ================================================================================ {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] allow_availability_zone_fallback = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] allow_compression_on_image_upload = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] allowed_direct_url_schemes = [] {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] api_rate_limit = True {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] auth_strategy = keystone {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_availability_zone = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_host = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_name = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_stats_polling_interval = 60 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backup_api_class = cinder.backup.api.API {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backup_name_template = backup-%s {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backup_use_same_host = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backup_use_temp_snapshot = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] chap_password = **** {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] chap_username = {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cinder_internal_tenant_project_id = 431bc600ccd44712842aa3a6fe1eedc4 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cinder_internal_tenant_user_id = 487034bb385a4e15905680b3854f2353 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cluster = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] compression_format = gzip {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] compute_api_class = cinder.compute.nova.API {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] config_dir = [] {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] config_source = [] {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[87128]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] control_exchange = openstack {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] debug = True {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] default_availability_zone = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] default_group_type = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] default_volume_type = QuobyteHD {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] disk_geometry = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] driver_client_cert = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] driver_client_cert_key = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] driver_data_namespace = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] driver_ssl_cert_path = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] driver_ssl_cert_verify = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] driver_use_ssl = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] enable_new_services = True {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] enable_unsupported_driver = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] enabled_backends = ['QuobyteHD'] {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] enforce_multipath_for_image_xfer = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] filter_function = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] glance_api_insecure = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] glance_api_servers = ['http://192.168.122.25/image'] {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] glance_api_ssl_compression = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] glance_ca_certificates_file = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] glance_catalog_info = image:glance:publicURL {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] glance_certfile = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] glance_keyfile = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] glance_num_retries = 3 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] glance_request_timeout = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] goodness_function = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] graceful_shutdown_timeout = 5 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] group_api_class = cinder.group.api.API {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] host = devstack {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] image_compress_on_upload = True {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] image_conversion_address_space_limit = 1 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] image_conversion_cpu_limit = 60 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] image_conversion_disable = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] image_upload_use_cinder_backend = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] image_upload_use_internal_tenant = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] image_volume_cache_enabled = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] image_volume_cache_max_count = 0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] image_volume_cache_max_size_gb = 0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] init_host_max_objects_retrieval = 0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] instance_format = [instance: %(uuid)s] {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] iscsi_target_flags = {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] iscsi_write_cache = on {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] iser_helper = tgtadm {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] iser_ip_address = 192.168.122.25 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] iser_port = 3260 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] log_color = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] log_config_append = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] log_dir = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] log_file = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] log_options = True {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] log_rotate_interval = 1 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] log_rotate_interval_type = days {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] log_rotation_type = none {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] max_age = 0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] max_logfile_count = 30 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] max_logfile_size_mb = 200 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] max_over_subscription_ratio = 20.0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] message_reap_interval = 86400 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] message_ttl = 2592000 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] migration_create_volume_timeout_secs = 300 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] monkey_patch = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] monkey_patch_modules = [] {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] my_ip = 192.168.122.25 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] no_snapshot_gb_quota = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] num_iser_scan_tries = 3 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] num_shell_tries = 3 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] num_volume_device_scan_tries = 3 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] nvmeof_conn_info_version = 1 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] nvmet_ns_id = 10 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] nvmet_port_id = 1 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] osapi_max_limit = 1000 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] osapi_volume_ext_list = [] {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] osapi_volume_listen_port = 8776 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] osapi_volume_use_ssl = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] osapi_volume_workers = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] per_volume_size_limit = -1 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] periodic_fuzzy_delay = 60 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] periodic_interval = 60 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] public_endpoint = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] publish_errors = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] quota_backup_gigabytes = 1000 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] quota_backups = 10 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] quota_gigabytes = 1000 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] quota_groups = 10 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] quota_snapshots = 10 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] quota_volumes = 10 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] rate_limit_burst = 0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] rate_limit_except_level = CRITICAL {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] rate_limit_interval = 0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] reinit_driver_count = 3 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] replication_device = **** {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] report_discard_supported = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] report_interval = 120 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] reservation_clean_interval = 86400 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] reservation_expire = 86400 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] reserved_image_namespaces = [] {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] reserved_percentage = 0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] rpc_response_timeout = 120 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] run_external_periodic_tasks = True {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] scst_target_driver = iscsi {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] scst_target_iqn_name = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] service_down_time = 720 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] shell_completion = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Starting volume driver QuobyteDriver (1.2.1) Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] snapshot_name_template = snapshot-%s {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] split_loggers = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] state_path = /opt/stack/data/cinder {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] storage_availability_zone = nova {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] storage_protocol = iSCSI {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87128) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] syslog_log_facility = LOG_USER {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] target_helper = lioadm {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] target_ip_address = 192.168.122.25 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] target_port = 3260 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] target_protocol = iscsi {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] target_secondary_ip_addresses = [] {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] trace_flags = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] transport_url = **** {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] until_refresh = 0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] use_chap_auth = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] use_default_quota_class = True {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] use_journal = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] use_json = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] use_multipath_for_image_xfer = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] use_stderr = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] use_syslog = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] verify_glance_signatures = enabled {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] volume_api_class = cinder.volume.api.API {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] volume_backend_name = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] volume_clear = zero {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] volume_clear_ionice = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] volume_clear_size = 0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] volume_copy_bps_limit = 0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] volume_dd_blocksize = 1M {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] volume_name_template = volume-%s {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] volume_service_inithost_offload = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] volume_usage_audit_period = month {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] zoning_mode = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_concurrency.disable_process_locking = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.auth_section = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.auth_type = password {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.auth_version = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.cache = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.certfile = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.include_service_catalog = True {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.insecure = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.interface = public {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.keyfile = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.memcache_password = **** {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.memcache_username = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.region_name = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.service_type = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.25/identity {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.backend = dogpile.cache.null {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.backend_argument = **** {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.backend_expiration_time = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.config_prefix = cache.oslo {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.debug_cache_backend = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.enable_retry_client = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.enable_socket_keepalive = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.enabled = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.expiration_time = 600 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.hashclient_retry_attempts = 2 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.memcache_dead_retry = 300 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.memcache_pool_maxsize = 10 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.memcache_sasl_enabled = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.password = **** {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.proxies = [] {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.redis_db = 0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.redis_server = localhost:6379 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.retry_attempts = 2 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.retry_delay = 0.0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.socket_keepalive_count = 1 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.socket_keepalive_idle = 1 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.socket_keepalive_interval = 1 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.socket_timeout = 1.0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.tls_allowed_ciphers = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.tls_cafile = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.tls_certfile = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.tls_enabled = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.tls_keyfile = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cache.username = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] coordination.backend_url = **** {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] database.asyncio_connection = **** {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] database.asyncio_slave_connection = **** {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] database.backend = sqlalchemy {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] database.connection = **** {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] database.connection_debug = 0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] database.connection_parameters = {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] database.connection_recycle_time = 3600 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] database.connection_trace = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] database.db_inc_retry_interval = True {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] database.db_max_retries = 20 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] database.db_max_retry_interval = 10 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] database.db_retry_interval = 1 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] database.max_overflow = 50 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] database.max_pool_size = 5 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] database.max_retries = 10 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] database.mysql_wsrep_sync_wait = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] database.pool_timeout = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] database.retry_interval = 10 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] database.slave_connection = **** {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] database.sqlite_synchronous = True {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] database.synchronous_reader = True {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] database.use_db_reconnect = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_tracing.insecure = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] profiler.connection_string = messaging:// {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] profiler.enabled = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] profiler.es_doc_type = notification {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] profiler.es_scroll_size = 10000 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] profiler.es_scroll_time = 2m {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] profiler.filter_error_trace = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] profiler.hmac_keys = **** {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] profiler.sentinel_service_name = mymaster {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] profiler.socket_timeout = 0.1 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] profiler.trace_requests = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] profiler.trace_sqlalchemy = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] profiler_jaeger.process_tags = {} {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] profiler_jaeger.service_name_prefix = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] profiler_otlp.service_name_prefix = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_policy.enforce_new_defaults = True {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_policy.policy_default_rule = default {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_policy.policy_file = policy.yaml {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] privsep_osbrick.group = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] privsep_osbrick.helper_command = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] privsep_osbrick.user = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cinder_sys_admin.group = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cinder_sys_admin.helper_command = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] cinder_sys_admin.user = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] service_user.auth_section = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] service_user.auth_type = password {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] service_user.cafile = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] service_user.certfile = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] service_user.collect_timing = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] service_user.insecure = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] service_user.keyfile = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] service_user.send_service_user_token = True {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] service_user.split_loggers = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] service_user.timeout = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] glance.auth_section = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] glance.auth_type = password {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] glance.certfile = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] glance.collect_timing = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] glance.insecure = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] glance.keyfile = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] glance.region_name = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] glance.split_loggers = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] glance.timeout = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.backend_availability_zone = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.chap_password = **** {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.chap_username = {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.disk_geometry = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.driver_client_cert = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.driver_client_cert_key = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.driver_data_namespace = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.driver_use_ssl = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.extra_capabilities = {} {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.filter_function = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.goodness_function = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.iscsi_target_flags = {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.iscsi_write_cache = on {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.iser_helper = tgtadm {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.iser_ip_address = 192.168.122.25 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.iser_port = 3260 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.nas_host = {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.nas_login = admin {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.nas_mount_options = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.nas_password = **** {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.nas_private_key = {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.nas_share_path = {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.num_shell_tries = 3 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.quobyte_volume_url = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.replication_device = **** {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.report_discard_supported = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.reserved_percentage = 0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.target_helper = tgtadm {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.target_ip_address = 192.168.122.25 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.target_port = 3260 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.target_protocol = iscsi {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.trace_flags = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.unique_fqdn_network = True {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.use_chap_auth = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.volume_backend_name = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.volume_clear = zero {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.volume_clear_ionice = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.volume_clear_size = 0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_reports.file_event_handler = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_reports.log_dir = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.backend_availability_zone = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.backend_host = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.chap_password = **** {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.chap_username = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.chiscsi_conf = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.disk_geometry = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.driver_client_cert = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.driver_data_namespace = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.driver_use_ssl = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.extra_capabilities = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.filter_function = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.goodness_function = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.iser_helper = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.iser_ip_address = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.iser_port = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.iser_target_prefix = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.nas_host = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.nas_login = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.nas_mount_options = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.nas_password = **** {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.nas_private_key = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.nas_share_path = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.nas_ssh_port = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.num_shell_tries = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.nvmet_port_id = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.replication_device = **** {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.report_discard_supported = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.reserved_percentage = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.scst_target_driver = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.storage_protocol = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.target_helper = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.target_ip_address = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.target_port = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.target_prefix = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.target_protocol = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.trace_flags = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.use_chap_auth = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.volume_clear = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.volume_clear_size = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] QuobyteHD.volumes_dir = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.ssl = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_notifications.driver = [] {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_notifications.retry = -1 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] key_manager.fixed_key = **** {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] barbican.barbican_api_version = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] barbican.barbican_endpoint = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87128) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] barbican.barbican_endpoint_type = public {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.quobyte [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] barbican.barbican_region_name = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] barbican.cafile = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] barbican.certfile = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] barbican.collect_timing = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] barbican.insecure = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] barbican.keyfile = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] barbican.number_of_retries = 60 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] barbican.retry_delay = 1 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] barbican.send_service_user_token = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] barbican.split_loggers = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.quobyte [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] barbican.timeout = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] barbican.verify_ssl = True {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] barbican.verify_ssl_path = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] barbican_service_user.auth_section = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] barbican_service_user.auth_type = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Running cmd (subprocess): mount.quobyte {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] barbican_service_user.cafile = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] barbican_service_user.certfile = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] barbican_service_user.collect_timing = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] barbican_service_user.insecure = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] barbican_service_user.keyfile = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] barbican_service_user.split_loggers = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] barbican_service_user.timeout = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] vault.approle_role_id = **** {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] vault.approle_secret_id = **** {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] vault.auth_method = approle {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] vault.auth_path = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] vault.kv_mountpoint = secret {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] vault.kv_path = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] vault.kv_version = 2 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] vault.namespace = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] vault.root_token_id = **** {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] vault.ssl_ca_crt_file = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] vault.timeout = 60.0 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] vault.token_file = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] vault.token_role = None {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] vault.use_ssl = False {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:56:32 devstack cinder-volume[86846]: DEBUG oslo_service.backend._eventlet.service [None req-1b83212e-ed10-4cc4-a225-d81ab22e7167 None None] ******************************************************************************** {{(pid=86846) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 01:56:32 devstack quobyte-client[87137]: Reading configuration file: /etc/quobyte/client.cfg Sep 01 01:56:32 devstack quobyte-client[87137]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 01 01:56:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] CMD "mount.quobyte" returned: 1 in 0.058s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:32 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:56:32 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:56:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:32 devstack sudo[87139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 01:56:32 devstack sudo[87139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:33 devstack sudo[87139]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.270s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:33 devstack cinder-volume[87128]: INFO cinder.volume.driver [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Driver hasn't implemented _init_vendor_properties() Sep 01 01:56:33 devstack cinder-volume[87128]: DEBUG cinder.volume.driver [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.0156593322754, 'free_capacity_gb': 1774.0156593322754, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87128) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 01:56:33 devstack cinder-volume[87128]: DEBUG oslo_db.sqlalchemy.engines [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87128) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:56:33 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writer thread running {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:56:33 devstack cinder-volume[87128]: DEBUG cinder.db.api [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Building query based on filter {{(pid=87128) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 01:56:33 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87128) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 01:56:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:56:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:56:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:33 devstack cinder-volume[87128]: INFO cinder.keymgr.migration [None req-75f46abc-ecd1-42e2-bbbe-bb046016353b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 01:56:33 devstack sudo[87142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 01:56:33 devstack sudo[87142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:33 devstack sudo[87142]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.229s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:33 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:56:33 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Driver initialization completed successfully. Sep 01 01:56:33 devstack cinder-volume[87128]: INFO cinder.manager [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Initiating service 3 cleanup Sep 01 01:56:33 devstack cinder-volume[87128]: INFO cinder.manager [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Service 3 cleanup completed. Sep 01 01:56:33 devstack cinder-volume[87128]: DEBUG cinder.service [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Creating RPC server for service cinder-volume {{(pid=87128) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 01:56:33 devstack cinder-volume[87128]: DEBUG cinder.service [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87128) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 01:56:33 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 01 01:56:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:56:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:56:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:33 devstack sudo[87155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 01:56:33 devstack sudo[87155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:33 devstack sudo[87155]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.234s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:33 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-5244913a-03ea-4b0b-85b1-f680aecdc33c None None] Driver post RPC initialization completed successfully. Sep 01 01:56:42 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:56:43 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=2 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:56:43 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:57:16 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager._thread_info {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:57:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread count: 6 {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:57:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread info: [<_MainThread(MainThread, started 128688016527488)>, , , , , ] {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:57:37 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:57:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] Flow 'volume_create_manager' (42877e7b-4409-4560-ad37-419b8e06699b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2995876-ec5e-4f0d-9fa4-71a6082afe6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2995876-ec5e-4f0d-9fa4-71a6082afe6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-240664685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e097c5-6a28-42f4-935f-ddc890b2195d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac11936b696841319e28ed7d789c6938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:38Z,use_quota=True,user_id='b0cd260dd532428c809d7a349836ca6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f1ffa7-3026-4aee-aba7-e1c1598f38c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f1ffa7-3026-4aee-aba7-e1c1598f38c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abc2f7a9-7b17-453a-bc31-40c874516a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abc2f7a9-7b17-453a-bc31-40c874516a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40e097c5-6a28-42f4-935f-ddc890b2195d', 'volume_name': 'volume-40e097c5-6a28-42f4-935f-ddc890b2195d', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b873e8f8-021f-40d5-83c2-7dd74d34ce56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b873e8f8-021f-40d5-83c2-7dd74d34ce56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b543117-cd78-40f7-8c90-2fa35ab7e7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:38 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] Volume 40e097c5-6a28-42f4-935f-ddc890b2195d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40e097c5-6a28-42f4-935f-ddc890b2195d', 'volume_size': 1} Sep 01 01:57:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:38 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-240664685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e097c5-6a28-42f4-935f-ddc890b2195d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac11936b696841319e28ed7d789c6938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:38Z,use_quota=True,user_id='b0cd260dd532428c809d7a349836ca6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:57:38 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] Creating volume 40e097c5-6a28-42f4-935f-ddc890b2195d {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:57:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:38 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:38 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:38 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:57:38 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 01:57:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40e097c5-6a28-42f4-935f-ddc890b2195d 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:38 devstack sudo[87761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40e097c5-6a28-42f4-935f-ddc890b2195d 1073741824 Sep 01 01:57:38 devstack sudo[87761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:38 devstack sudo[87761]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40e097c5-6a28-42f4-935f-ddc890b2195d 1073741824" returned: 0 in 0.773s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40e097c5-6a28-42f4-935f-ddc890b2195d {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:38 devstack sudo[88083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40e097c5-6a28-42f4-935f-ddc890b2195d Sep 01 01:57:38 devstack sudo[88083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:39 devstack sudo[88083]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40e097c5-6a28-42f4-935f-ddc890b2195d" returned: 0 in 0.433s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:39 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:57:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b543117-cd78-40f7-8c90-2fa35ab7e7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40e097c5-6a28-42f4-935f-ddc890b2195d', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e05893-e922-46e0-9b96-27014d0402c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:39 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] Volume volume-40e097c5-6a28-42f4-935f-ddc890b2195d (40e097c5-6a28-42f4-935f-ddc890b2195d): created successfully Sep 01 01:57:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e05893-e922-46e0-9b96-27014d0402c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] Flow 'volume_create_manager' (42877e7b-4409-4560-ad37-419b8e06699b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:39 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-9ee2ac33-9b7a-4f99-90d1-bfb630924afc tempest-DeleteServersTestJSON-2091283683 None] Created volume successfully. Sep 01 01:57:46 devstack cinder-volume[87128]: WARNING py.warnings [req-04736fd0-5645-4248-aa97-35ca950d1ad2 req-f3ff8dad-c32f-4db8-9ecd-64dbb93cee8f tempest-DeleteServersTestJSON-2091283683 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 01 01:57:46 devstack cinder-volume[87128]: .first() Sep 01 01:57:46 devstack cinder-volume[87128]: Sep 01 01:57:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-04736fd0-5645-4248-aa97-35ca950d1ad2 req-f3ff8dad-c32f-4db8-9ecd-64dbb93cee8f tempest-DeleteServersTestJSON-2091283683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-04736fd0-5645-4248-aa97-35ca950d1ad2 req-f3ff8dad-c32f-4db8-9ecd-64dbb93cee8f tempest-DeleteServersTestJSON-2091283683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-04736fd0-5645-4248-aa97-35ca950d1ad2 req-f3ff8dad-c32f-4db8-9ecd-64dbb93cee8f tempest-DeleteServersTestJSON-2091283683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-04736fd0-5645-4248-aa97-35ca950d1ad2 req-f3ff8dad-c32f-4db8-9ecd-64dbb93cee8f tempest-DeleteServersTestJSON-2091283683 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb', 'name': 'volume-40e097c5-6a28-42f4-935f-ddc890b2195d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cb564331-c3f6-48cd-9de0-5cf7ac1fcbb1', 'enforce_multipath': True} {{(pid=87128) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:57:47 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-04736fd0-5645-4248-aa97-35ca950d1ad2 req-f3ff8dad-c32f-4db8-9ecd-64dbb93cee8f tempest-DeleteServersTestJSON-2091283683 None] attachment_update completed successfully. Sep 01 01:57:53 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-ebe1c530-d282-47f6-87cb-22bd05acc7fd req-f91ff0b8-a97b-4d07-a3d9-d1d142eda1c1 tempest-DeleteServersTestJSON-2091283683 None] Terminate volume connection completed successfully. Sep 01 01:57:53 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-ebe1c530-d282-47f6-87cb-22bd05acc7fd req-f91ff0b8-a97b-4d07-a3d9-d1d142eda1c1 tempest-DeleteServersTestJSON-2091283683 None] Deleting attachment cb564331-c3f6-48cd-9de0-5cf7ac1fcbb1. {{(pid=87128) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:57:56 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-edb44be3-495e-41e2-b1d5-e40accf9deb9 tempest-DeleteServersTestJSON-2091283683 None] Acquiring lock "cinder-40e097c5-6a28-42f4-935f-ddc890b2195d-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:56 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-edb44be3-495e-41e2-b1d5-e40accf9deb9 tempest-DeleteServersTestJSON-2091283683 None] Lock "cinder-40e097c5-6a28-42f4-935f-ddc890b2195d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:56 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-edb44be3-495e-41e2-b1d5-e40accf9deb9 tempest-DeleteServersTestJSON-2091283683 None] Acquiring lock "cinder-quobyte-40e097c5-6a28-42f4-935f-ddc890b2195d" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:56 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-edb44be3-495e-41e2-b1d5-e40accf9deb9 tempest-DeleteServersTestJSON-2091283683 None] Lock "cinder-quobyte-40e097c5-6a28-42f4-935f-ddc890b2195d" acquired by "delete_volume" :: waited 0.028s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:56 devstack cinder-volume[87128]: INFO oslo.privsep.daemon [None req-edb44be3-495e-41e2-b1d5-e40accf9deb9 tempest-DeleteServersTestJSON-2091283683 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpc_3twoah/privsep.sock'] Sep 01 01:57:56 devstack sudo[88773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpc_3twoah/privsep.sock Sep 01 01:57:56 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:57 devstack cinder-volume[87128]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 01 01:57:57 devstack cinder-volume[87128]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 01:57:57 devstack cinder-volume[87128]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 01 01:57:57 devstack cinder-volume[87128]: WARNING oslo.privsep.daemon [-] privsep log: Sep 01 01:57:57 devstack cinder-volume[87128]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 01 01:57:57 devstack cinder-volume[87128]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 01 01:57:57 devstack cinder-volume[87128]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 01:57:57 devstack cinder-volume[87128]: WARNING oslo.privsep.daemon [-] privsep log: Sep 01 01:57:57 devstack cinder-volume[87128]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 01 01:57:58 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:58 devstack cinder-volume[87128]: INFO oslo.privsep.daemon [None req-edb44be3-495e-41e2-b1d5-e40accf9deb9 tempest-DeleteServersTestJSON-2091283683 None] Spawned new privsep daemon via rootwrap Sep 01 01:57:58 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [None req-edb44be3-495e-41e2-b1d5-e40accf9deb9 tempest-DeleteServersTestJSON-2091283683 None] Accepted privsep connection to /tmp/tmpc_3twoah/privsep.sock {{(pid=87128) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 01 01:57:58 devstack cinder-volume[87128]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 01 01:57:58 devstack cinder-volume[87128]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 01 01:57:58 devstack cinder-volume[87128]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 01 01:57:58 devstack cinder-volume[87128]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88782 Sep 01 01:57:58 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd185d7-f365-4dd1-811c-a4912c08d248]: (2,) {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:58 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[42be3f5b-8b56-4e58-8f84-3f300ea383cf]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-edb44be3-495e-41e2-b1d5-e40accf9deb9 tempest-DeleteServersTestJSON-2091283683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40e097c5-6a28-42f4-935f-ddc890b2195d {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:58 devstack sudo[88784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40e097c5-6a28-42f4-935f-ddc890b2195d Sep 01 01:57:58 devstack sudo[88784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:58 devstack sudo[88784]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-edb44be3-495e-41e2-b1d5-e40accf9deb9 tempest-DeleteServersTestJSON-2091283683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40e097c5-6a28-42f4-935f-ddc890b2195d" returned: 0 in 0.516s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-edb44be3-495e-41e2-b1d5-e40accf9deb9 tempest-DeleteServersTestJSON-2091283683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40e097c5-6a28-42f4-935f-ddc890b2195d {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:58 devstack sudo[88789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40e097c5-6a28-42f4-935f-ddc890b2195d Sep 01 01:57:58 devstack sudo[88789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:59 devstack sudo[88789]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-edb44be3-495e-41e2-b1d5-e40accf9deb9 tempest-DeleteServersTestJSON-2091283683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40e097c5-6a28-42f4-935f-ddc890b2195d" returned: 0 in 0.408s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:59 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-edb44be3-495e-41e2-b1d5-e40accf9deb9 tempest-DeleteServersTestJSON-2091283683 None] Lock "cinder-quobyte-40e097c5-6a28-42f4-935f-ddc890b2195d" released by "delete_volume" :: held 2.926s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:59 devstack cinder-volume[87128]: WARNING cinder.quota [None req-edb44be3-495e-41e2-b1d5-e40accf9deb9 tempest-DeleteServersTestJSON-2091283683 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:57:59 devstack cinder-volume[87128]: WARNING cinder.quota [None req-edb44be3-495e-41e2-b1d5-e40accf9deb9 tempest-DeleteServersTestJSON-2091283683 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:57:59 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-edb44be3-495e-41e2-b1d5-e40accf9deb9 tempest-DeleteServersTestJSON-2091283683 None] Created reservations ['20b6f0f7-2b10-4f7d-b36c-82de9c04408b', '8cb25e49-2e08-4a71-8b62-c6a4f13c9491', '9f6906c0-dcb2-4b40-a7ef-3bd112523b2a', '8d739cd1-2a47-458a-a5b3-849cfec7ab5f'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:57:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-edb44be3-495e-41e2-b1d5-e40accf9deb9 tempest-DeleteServersTestJSON-2091283683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-edb44be3-495e-41e2-b1d5-e40accf9deb9 tempest-DeleteServersTestJSON-2091283683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:59 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-edb44be3-495e-41e2-b1d5-e40accf9deb9 tempest-DeleteServersTestJSON-2091283683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:59 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-edb44be3-495e-41e2-b1d5-e40accf9deb9 tempest-DeleteServersTestJSON-2091283683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-edb44be3-495e-41e2-b1d5-e40accf9deb9 tempest-DeleteServersTestJSON-2091283683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-edb44be3-495e-41e2-b1d5-e40accf9deb9 tempest-DeleteServersTestJSON-2091283683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:59 devstack sudo[88834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 01:57:59 devstack sudo[88834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:00 devstack sudo[88834]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-edb44be3-495e-41e2-b1d5-e40accf9deb9 tempest-DeleteServersTestJSON-2091283683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.632s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:00 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-edb44be3-495e-41e2-b1d5-e40accf9deb9 tempest-DeleteServersTestJSON-2091283683 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:58:00 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-edb44be3-495e-41e2-b1d5-e40accf9deb9 tempest-DeleteServersTestJSON-2091283683 None] Deleted volume successfully. Sep 01 01:58:00 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-edb44be3-495e-41e2-b1d5-e40accf9deb9 tempest-DeleteServersTestJSON-2091283683 None] Lock "cinder-40e097c5-6a28-42f4-935f-ddc890b2195d-delete_volume" released by "delete_volume" :: held 4.091s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:00 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:58:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] Flow 'volume_create_manager' (97cfe8ae-df45-46f3-bd19-3ebfa7e09e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c584f0-51b2-49b2-8f32-19ac8b0312b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c584f0-51b2-49b2-8f32-19ac8b0312b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1979796878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1269a01b-ec36-4b3e-92cc-5e5b00ea9a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='543bcaea95484e4db1464fb7c56d8c66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:00Z,use_quota=True,user_id='b576a4be3fdb41cc9ce2d033d7f9dc16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e43c05e-ec3f-4b03-9646-229959dbe9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e43c05e-ec3f-4b03-9646-229959dbe9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b749674-90b1-4545-bb2b-13afc95ad972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b749674-90b1-4545-bb2b-13afc95ad972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1269a01b-ec36-4b3e-92cc-5e5b00ea9a46', 'volume_name': 'volume-1269a01b-ec36-4b3e-92cc-5e5b00ea9a46', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4497769-f1db-4442-af77-8d1af9a44b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4497769-f1db-4442-af77-8d1af9a44b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e65bd6a8-a442-4572-a9a5-e692d8e2bbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:00 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] Volume 1269a01b-ec36-4b3e-92cc-5e5b00ea9a46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1269a01b-ec36-4b3e-92cc-5e5b00ea9a46', 'volume_size': 1} Sep 01 01:58:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:00 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1979796878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1269a01b-ec36-4b3e-92cc-5e5b00ea9a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='543bcaea95484e4db1464fb7c56d8c66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:00Z,use_quota=True,user_id='b576a4be3fdb41cc9ce2d033d7f9dc16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:58:00 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] Creating volume 1269a01b-ec36-4b3e-92cc-5e5b00ea9a46 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:58:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:00 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:00 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:00 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:58:00 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 01:58:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1269a01b-ec36-4b3e-92cc-5e5b00ea9a46 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:00 devstack sudo[88837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1269a01b-ec36-4b3e-92cc-5e5b00ea9a46 1073741824 Sep 01 01:58:00 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:01 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1269a01b-ec36-4b3e-92cc-5e5b00ea9a46 1073741824" returned: 0 in 0.727s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1269a01b-ec36-4b3e-92cc-5e5b00ea9a46 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:01 devstack sudo[88844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1269a01b-ec36-4b3e-92cc-5e5b00ea9a46 Sep 01 01:58:01 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:01 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1269a01b-ec36-4b3e-92cc-5e5b00ea9a46" returned: 0 in 0.296s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:01 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:58:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e65bd6a8-a442-4572-a9a5-e692d8e2bbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1269a01b-ec36-4b3e-92cc-5e5b00ea9a46', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (804ae5fc-4177-4431-bb99-2814046d4f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:01 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] Volume volume-1269a01b-ec36-4b3e-92cc-5e5b00ea9a46 (1269a01b-ec36-4b3e-92cc-5e5b00ea9a46): created successfully Sep 01 01:58:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (804ae5fc-4177-4431-bb99-2814046d4f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] Flow 'volume_create_manager' (97cfe8ae-df45-46f3-bd19-3ebfa7e09e9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:01 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-e339b8f3-f531-4e90-9908-3ff5d61b697b tempest-VolumesAdminNegativeTest-1091428370 None] Created volume successfully. Sep 01 01:58:03 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-76f88d5a-9598-4288-abd8-453c62c85132 tempest-VolumesAdminNegativeTest-1091428370 None] Acquiring lock "cinder-1269a01b-ec36-4b3e-92cc-5e5b00ea9a46-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:03 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-76f88d5a-9598-4288-abd8-453c62c85132 tempest-VolumesAdminNegativeTest-1091428370 None] Lock "cinder-1269a01b-ec36-4b3e-92cc-5e5b00ea9a46-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:03 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-76f88d5a-9598-4288-abd8-453c62c85132 tempest-VolumesAdminNegativeTest-1091428370 None] Acquiring lock "cinder-quobyte-1269a01b-ec36-4b3e-92cc-5e5b00ea9a46" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:03 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-76f88d5a-9598-4288-abd8-453c62c85132 tempest-VolumesAdminNegativeTest-1091428370 None] Lock "cinder-quobyte-1269a01b-ec36-4b3e-92cc-5e5b00ea9a46" acquired by "delete_volume" :: waited 0.035s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:03 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[d103d393-2891-4f7c-bc27-c3ea5b7e3423]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-76f88d5a-9598-4288-abd8-453c62c85132 tempest-VolumesAdminNegativeTest-1091428370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1269a01b-ec36-4b3e-92cc-5e5b00ea9a46 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:03 devstack sudo[88848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1269a01b-ec36-4b3e-92cc-5e5b00ea9a46 Sep 01 01:58:03 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:03 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-76f88d5a-9598-4288-abd8-453c62c85132 tempest-VolumesAdminNegativeTest-1091428370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1269a01b-ec36-4b3e-92cc-5e5b00ea9a46" returned: 0 in 0.422s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-76f88d5a-9598-4288-abd8-453c62c85132 tempest-VolumesAdminNegativeTest-1091428370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1269a01b-ec36-4b3e-92cc-5e5b00ea9a46 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:03 devstack sudo[88853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1269a01b-ec36-4b3e-92cc-5e5b00ea9a46 Sep 01 01:58:03 devstack sudo[88853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:04 devstack sudo[88853]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-76f88d5a-9598-4288-abd8-453c62c85132 tempest-VolumesAdminNegativeTest-1091428370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1269a01b-ec36-4b3e-92cc-5e5b00ea9a46" returned: 0 in 0.350s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:04 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-76f88d5a-9598-4288-abd8-453c62c85132 tempest-VolumesAdminNegativeTest-1091428370 None] Lock "cinder-quobyte-1269a01b-ec36-4b3e-92cc-5e5b00ea9a46" released by "delete_volume" :: held 0.848s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:04 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-76f88d5a-9598-4288-abd8-453c62c85132 tempest-VolumesAdminNegativeTest-1091428370 None] Created reservations ['2b1858e8-8356-4410-84e2-fddf7dea5717', 'eae80a0b-5b5b-46f7-966a-3888ee810b0b', '51c494d5-15ed-4298-a979-b8a3957c16e1', '36987cf4-6110-425b-a3ff-4b9d1b462a4d'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:58:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-76f88d5a-9598-4288-abd8-453c62c85132 tempest-VolumesAdminNegativeTest-1091428370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-76f88d5a-9598-4288-abd8-453c62c85132 tempest-VolumesAdminNegativeTest-1091428370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:04 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-76f88d5a-9598-4288-abd8-453c62c85132 tempest-VolumesAdminNegativeTest-1091428370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:04 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-76f88d5a-9598-4288-abd8-453c62c85132 tempest-VolumesAdminNegativeTest-1091428370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-76f88d5a-9598-4288-abd8-453c62c85132 tempest-VolumesAdminNegativeTest-1091428370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-76f88d5a-9598-4288-abd8-453c62c85132 tempest-VolumesAdminNegativeTest-1091428370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:04 devstack sudo[88856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 01:58:04 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:04 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-76f88d5a-9598-4288-abd8-453c62c85132 tempest-VolumesAdminNegativeTest-1091428370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.460s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:04 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-76f88d5a-9598-4288-abd8-453c62c85132 tempest-VolumesAdminNegativeTest-1091428370 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:58:04 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-76f88d5a-9598-4288-abd8-453c62c85132 tempest-VolumesAdminNegativeTest-1091428370 None] Deleted volume successfully. Sep 01 01:58:04 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-76f88d5a-9598-4288-abd8-453c62c85132 tempest-VolumesAdminNegativeTest-1091428370 None] Lock "cinder-1269a01b-ec36-4b3e-92cc-5e5b00ea9a46-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:14 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=25,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:58:14 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:UPDATE=20,cinder:SELECT=18,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:58:16 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:58:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] Flow 'volume_create_manager' (ca2e0baa-84cd-4f21-9c8a-118e0728522a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f552ce-008c-48ef-b7b5-89931269005f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f552ce-008c-48ef-b7b5-89931269005f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-952123736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7932ce89-cde7-4986-823e-7c0631d0b8ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d0ea659402b4827a795c4eadd9b9452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:16Z,use_quota=True,user_id='6571fc5019b946d1bd553a49f65dca89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92b01eb5-adf7-4443-8ef0-9a73e7b04059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92b01eb5-adf7-4443-8ef0-9a73e7b04059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dabe8628-8882-4836-95a4-43fe3975c500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dabe8628-8882-4836-95a4-43fe3975c500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7932ce89-cde7-4986-823e-7c0631d0b8ee', 'volume_name': 'volume-7932ce89-cde7-4986-823e-7c0631d0b8ee', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d40858-ce20-49d3-8ed1-45fc7af708f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d40858-ce20-49d3-8ed1-45fc7af708f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd229fe8-2cbe-4a0e-b284-55e5b3439163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:16 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] Volume 7932ce89-cde7-4986-823e-7c0631d0b8ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7932ce89-cde7-4986-823e-7c0631d0b8ee', 'volume_size': 1} Sep 01 01:58:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-952123736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7932ce89-cde7-4986-823e-7c0631d0b8ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d0ea659402b4827a795c4eadd9b9452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:16Z,use_quota=True,user_id='6571fc5019b946d1bd553a49f65dca89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:58:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] Creating volume 7932ce89-cde7-4986-823e-7c0631d0b8ee {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:58:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:58:16 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 01:58:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7932ce89-cde7-4986-823e-7c0631d0b8ee 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:16 devstack sudo[88929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7932ce89-cde7-4986-823e-7c0631d0b8ee 1073741824 Sep 01 01:58:16 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:16 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:58:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:16 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7932ce89-cde7-4986-823e-7c0631d0b8ee 1073741824" returned: 0 in 0.539s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:16 devstack sudo[88937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 01:58:16 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7932ce89-cde7-4986-823e-7c0631d0b8ee {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:17 devstack sudo[88939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7932ce89-cde7-4986-823e-7c0631d0b8ee Sep 01 01:58:17 devstack sudo[88939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:17 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.336s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:17 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:58:17 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager._thread_info {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:58:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread count: 8 {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:58:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread info: [<_MainThread(MainThread, started 128688016527488)>, , , , , , , ] {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:58:17 devstack sudo[88939]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7932ce89-cde7-4986-823e-7c0631d0b8ee" returned: 0 in 0.324s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:58:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd229fe8-2cbe-4a0e-b284-55e5b3439163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7932ce89-cde7-4986-823e-7c0631d0b8ee', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2506e71-8fe9-4eb2-9b2b-af5e52876422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:17 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] Volume volume-7932ce89-cde7-4986-823e-7c0631d0b8ee (7932ce89-cde7-4986-823e-7c0631d0b8ee): created successfully Sep 01 01:58:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2506e71-8fe9-4eb2-9b2b-af5e52876422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] Flow 'volume_create_manager' (ca2e0baa-84cd-4f21-9c8a-118e0728522a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:17 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-3d88b33b-011a-4465-afe7-870f98942a5a tempest-ServerActionsTestOtherA-1922255062 None] Created volume successfully. Sep 01 01:58:27 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=1,cinder:UPDATE=4 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:58:27 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:58:34 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:58:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] Flow 'volume_create_manager' (c667c624-5110-448f-8007-e61ea5c9f389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a53d552-89d9-4265-a484-83e1da0ae42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a53d552-89d9-4265-a484-83e1da0ae42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-956093311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d3fde3-6c08-440a-9b9d-ebba0bc3d0e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f43ec543b4c41898c2873771eabbd38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:34Z,use_quota=True,user_id='da84078a98f44128a095bd0c04a76bb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b07dc75d-155a-46a6-8a9a-90a52751ef65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b07dc75d-155a-46a6-8a9a-90a52751ef65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b40485-e660-4fb6-99d5-201c23a48af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b40485-e660-4fb6-99d5-201c23a48af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33d3fde3-6c08-440a-9b9d-ebba0bc3d0e9', 'volume_name': 'volume-33d3fde3-6c08-440a-9b9d-ebba0bc3d0e9', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a3bdee-41c2-41a2-987b-e1b2e6595d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a3bdee-41c2-41a2-987b-e1b2e6595d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (599258f4-c864-4998-aeda-6f4f8cf59bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:34 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] Volume 33d3fde3-6c08-440a-9b9d-ebba0bc3d0e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33d3fde3-6c08-440a-9b9d-ebba0bc3d0e9', 'volume_size': 1} Sep 01 01:58:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:34 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-956093311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d3fde3-6c08-440a-9b9d-ebba0bc3d0e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f43ec543b4c41898c2873771eabbd38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:34Z,use_quota=True,user_id='da84078a98f44128a095bd0c04a76bb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:58:34 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] Creating volume 33d3fde3-6c08-440a-9b9d-ebba0bc3d0e9 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:58:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:34 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:34 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:34 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:58:34 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 01:58:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-33d3fde3-6c08-440a-9b9d-ebba0bc3d0e9 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:34 devstack sudo[89004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-33d3fde3-6c08-440a-9b9d-ebba0bc3d0e9 1073741824 Sep 01 01:58:34 devstack sudo[89004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:34 devstack sudo[89004]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-33d3fde3-6c08-440a-9b9d-ebba0bc3d0e9 1073741824" returned: 0 in 0.607s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-33d3fde3-6c08-440a-9b9d-ebba0bc3d0e9 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:34 devstack sudo[89011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-33d3fde3-6c08-440a-9b9d-ebba0bc3d0e9 Sep 01 01:58:34 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:35 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-33d3fde3-6c08-440a-9b9d-ebba0bc3d0e9" returned: 0 in 0.287s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:35 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:58:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:35 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (599258f4-c864-4998-aeda-6f4f8cf59bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33d3fde3-6c08-440a-9b9d-ebba0bc3d0e9', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:35 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66812397-2af4-4cc8-a62e-a894b4f2b95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:35 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] Volume volume-33d3fde3-6c08-440a-9b9d-ebba0bc3d0e9 (33d3fde3-6c08-440a-9b9d-ebba0bc3d0e9): created successfully Sep 01 01:58:35 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66812397-2af4-4cc8-a62e-a894b4f2b95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:35 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] Flow 'volume_create_manager' (c667c624-5110-448f-8007-e61ea5c9f389) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:35 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-9a316b37-84b0-436f-abfb-9158faefbc85 tempest-TaggedAttachmentsTest-636050106 None] Created volume successfully. Sep 01 01:58:45 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:58:45 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:59:12 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:59:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] Flow 'volume_create_manager' (988fecfc-87bd-4b5a-9fa9-d4e791988aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:59:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0def19b7-41f0-43d9-b420-e4f59a1a77fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0def19b7-41f0-43d9-b420-e4f59a1a77fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1713668785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a14ab9a8-4b5f-462b-b57c-43c0fca5911d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='def3d036e435400ca4c8dc00c31ffeee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:59:12Z,use_quota=True,user_id='c9478394f6d1442b8020567ad6eea864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ce1419a-eedd-43cd-a995-fa43900654c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ce1419a-eedd-43cd-a995-fa43900654c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b425e5d-f5c9-491f-8c0f-cbd9c78d90ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b425e5d-f5c9-491f-8c0f-cbd9c78d90ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a14ab9a8-4b5f-462b-b57c-43c0fca5911d', 'volume_name': 'volume-a14ab9a8-4b5f-462b-b57c-43c0fca5911d', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a162873-4b7f-49fd-9011-75d07c0ceadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a162873-4b7f-49fd-9011-75d07c0ceadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a2ce78-0a97-4aa4-af75-0464b5b6963b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:12 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] Volume a14ab9a8-4b5f-462b-b57c-43c0fca5911d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a14ab9a8-4b5f-462b-b57c-43c0fca5911d', 'volume_size': 1} Sep 01 01:59:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:12 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1713668785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a14ab9a8-4b5f-462b-b57c-43c0fca5911d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='def3d036e435400ca4c8dc00c31ffeee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:59:12Z,use_quota=True,user_id='c9478394f6d1442b8020567ad6eea864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:59:12 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] Creating volume a14ab9a8-4b5f-462b-b57c-43c0fca5911d {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:59:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:12 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:12 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:12 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:59:12 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 01:59:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a14ab9a8-4b5f-462b-b57c-43c0fca5911d 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:12 devstack sudo[89481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a14ab9a8-4b5f-462b-b57c-43c0fca5911d 1073741824 Sep 01 01:59:12 devstack sudo[89481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:13 devstack sudo[89481]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a14ab9a8-4b5f-462b-b57c-43c0fca5911d 1073741824" returned: 0 in 0.856s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a14ab9a8-4b5f-462b-b57c-43c0fca5911d {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:13 devstack sudo[89492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a14ab9a8-4b5f-462b-b57c-43c0fca5911d Sep 01 01:59:13 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:13 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a14ab9a8-4b5f-462b-b57c-43c0fca5911d" returned: 0 in 0.331s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:13 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:59:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:13 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a2ce78-0a97-4aa4-af75-0464b5b6963b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a14ab9a8-4b5f-462b-b57c-43c0fca5911d', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:13 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8caa3d-e55f-4bf1-8659-b2bdee828937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:13 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] Volume volume-a14ab9a8-4b5f-462b-b57c-43c0fca5911d (a14ab9a8-4b5f-462b-b57c-43c0fca5911d): created successfully Sep 01 01:59:13 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8caa3d-e55f-4bf1-8659-b2bdee828937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:13 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] Flow 'volume_create_manager' (988fecfc-87bd-4b5a-9fa9-d4e791988aad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:59:13 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-1f39c6d7-4a10-4c9b-a8f3-e02857a607cf tempest-ServersNegativeTestJSON-1895896711 None] Created volume successfully. Sep 01 01:59:16 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:59:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:17 devstack sudo[89556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 01:59:17 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:17 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:59:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] Flow 'volume_create_manager' (6f119bbe-85c4-4fd0-9235-bece11e5790e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:59:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b5e366-d7ce-416b-a064-ff41e9835811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:17 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.734s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:17 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:59:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b5e366-d7ce-416b-a064-ff41e9835811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-638872127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc07daeb-2945-4a5d-99ef-d5bad70aed0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='def3d036e435400ca4c8dc00c31ffeee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:59:17Z,use_quota=True,user_id='c9478394f6d1442b8020567ad6eea864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61737213-13e9-47ad-8fa6-8f4858240b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61737213-13e9-47ad-8fa6-8f4858240b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61355fea-2f67-4aba-bb33-0b710fecd512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61355fea-2f67-4aba-bb33-0b710fecd512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc07daeb-2945-4a5d-99ef-d5bad70aed0c', 'volume_name': 'volume-bc07daeb-2945-4a5d-99ef-d5bad70aed0c', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d87f48ed-4e3d-4cb6-9c8a-eb109a23a66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d87f48ed-4e3d-4cb6-9c8a-eb109a23a66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd52615e-f307-498f-8f77-92a5fa3b1923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:17 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] Volume bc07daeb-2945-4a5d-99ef-d5bad70aed0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc07daeb-2945-4a5d-99ef-d5bad70aed0c', 'volume_size': 1} Sep 01 01:59:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-638872127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc07daeb-2945-4a5d-99ef-d5bad70aed0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='def3d036e435400ca4c8dc00c31ffeee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:59:17Z,use_quota=True,user_id='c9478394f6d1442b8020567ad6eea864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:59:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] Creating volume bc07daeb-2945-4a5d-99ef-d5bad70aed0c {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:59:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:59:18 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 01:59:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bc07daeb-2945-4a5d-99ef-d5bad70aed0c 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:18 devstack sudo[89590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bc07daeb-2945-4a5d-99ef-d5bad70aed0c 1073741824 Sep 01 01:59:18 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-22bbb3b9-8d49-4fe0-9fba-0ede51088da8 req-235f862c-8a92-439e-8a68-7159a4f78fc7 tempest-ServerActionsTestOtherA-1922255062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:20 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bc07daeb-2945-4a5d-99ef-d5bad70aed0c 1073741824" returned: 0 in 2.050s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bc07daeb-2945-4a5d-99ef-d5bad70aed0c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:20 devstack sudo[89644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bc07daeb-2945-4a5d-99ef-d5bad70aed0c Sep 01 01:59:20 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:20 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bc07daeb-2945-4a5d-99ef-d5bad70aed0c" returned: 0 in 0.784s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:20 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] <== create_volume: return (2956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:59:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.966s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-22bbb3b9-8d49-4fe0-9fba-0ede51088da8 req-235f862c-8a92-439e-8a68-7159a4f78fc7 tempest-ServerActionsTestOtherA-1922255062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.216s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd52615e-f307-498f-8f77-92a5fa3b1923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc07daeb-2945-4a5d-99ef-d5bad70aed0c', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b163566-f904-4d81-975e-c5bc8dd3325a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:21 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] Volume volume-bc07daeb-2945-4a5d-99ef-d5bad70aed0c (bc07daeb-2945-4a5d-99ef-d5bad70aed0c): created successfully Sep 01 01:59:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b163566-f904-4d81-975e-c5bc8dd3325a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] Flow 'volume_create_manager' (6f119bbe-85c4-4fd0-9235-bece11e5790e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:59:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-22bbb3b9-8d49-4fe0-9fba-0ede51088da8 req-235f862c-8a92-439e-8a68-7159a4f78fc7 tempest-ServerActionsTestOtherA-1922255062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.140s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:21 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-a49e3cf0-8371-4314-83b1-9849f2070fc4 tempest-ServersNegativeTestJSON-1895896711 None] Created volume successfully. Sep 01 01:59:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-22bbb3b9-8d49-4fe0-9fba-0ede51088da8 req-235f862c-8a92-439e-8a68-7159a4f78fc7 tempest-ServerActionsTestOtherA-1922255062 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb', 'name': 'volume-7932ce89-cde7-4986-823e-7c0631d0b8ee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7bec93b1-19df-460b-818e-7eb016a1af5e', 'enforce_multipath': True} {{(pid=87128) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:59:21 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-22bbb3b9-8d49-4fe0-9fba-0ede51088da8 req-235f862c-8a92-439e-8a68-7159a4f78fc7 tempest-ServerActionsTestOtherA-1922255062 None] attachment_update completed successfully. Sep 01 01:59:22 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-00612310-0e0a-4a92-8d86-b35253a42493 tempest-ServersNegativeTestJSON-1895896711 None] Acquiring lock "cinder-bc07daeb-2945-4a5d-99ef-d5bad70aed0c-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-00612310-0e0a-4a92-8d86-b35253a42493 tempest-ServersNegativeTestJSON-1895896711 None] Lock "cinder-bc07daeb-2945-4a5d-99ef-d5bad70aed0c-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-00612310-0e0a-4a92-8d86-b35253a42493 tempest-ServersNegativeTestJSON-1895896711 None] Acquiring lock "cinder-quobyte-bc07daeb-2945-4a5d-99ef-d5bad70aed0c" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-00612310-0e0a-4a92-8d86-b35253a42493 tempest-ServersNegativeTestJSON-1895896711 None] Lock "cinder-quobyte-bc07daeb-2945-4a5d-99ef-d5bad70aed0c" acquired by "delete_volume" :: waited 0.021s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:23 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff367261-bd1a-4fac-8337-86c23fe463ff]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-00612310-0e0a-4a92-8d86-b35253a42493 tempest-ServersNegativeTestJSON-1895896711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bc07daeb-2945-4a5d-99ef-d5bad70aed0c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:23 devstack sudo[90042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bc07daeb-2945-4a5d-99ef-d5bad70aed0c Sep 01 01:59:23 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:23 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-00612310-0e0a-4a92-8d86-b35253a42493 tempest-ServersNegativeTestJSON-1895896711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bc07daeb-2945-4a5d-99ef-d5bad70aed0c" returned: 0 in 0.694s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-00612310-0e0a-4a92-8d86-b35253a42493 tempest-ServersNegativeTestJSON-1895896711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bc07daeb-2945-4a5d-99ef-d5bad70aed0c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:23 devstack sudo[90065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bc07daeb-2945-4a5d-99ef-d5bad70aed0c Sep 01 01:59:23 devstack sudo[90065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:24 devstack sudo[90065]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-00612310-0e0a-4a92-8d86-b35253a42493 tempest-ServersNegativeTestJSON-1895896711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bc07daeb-2945-4a5d-99ef-d5bad70aed0c" returned: 0 in 0.626s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-00612310-0e0a-4a92-8d86-b35253a42493 tempest-ServersNegativeTestJSON-1895896711 None] Lock "cinder-quobyte-bc07daeb-2945-4a5d-99ef-d5bad70aed0c" released by "delete_volume" :: held 1.402s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:24 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-00612310-0e0a-4a92-8d86-b35253a42493 tempest-ServersNegativeTestJSON-1895896711 None] Created reservations ['da051401-9107-464f-8637-be644cf98496', '9af82f2e-3947-456f-b925-0016554ed72e', 'f8476833-3d8f-4a8c-9d9b-b2f851b760db', '21d338c4-ec6d-4f1b-a027-43377fd57974'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:59:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-00612310-0e0a-4a92-8d86-b35253a42493 tempest-ServersNegativeTestJSON-1895896711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-00612310-0e0a-4a92-8d86-b35253a42493 tempest-ServersNegativeTestJSON-1895896711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:24 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-00612310-0e0a-4a92-8d86-b35253a42493 tempest-ServersNegativeTestJSON-1895896711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:24 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-00612310-0e0a-4a92-8d86-b35253a42493 tempest-ServersNegativeTestJSON-1895896711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-00612310-0e0a-4a92-8d86-b35253a42493 tempest-ServersNegativeTestJSON-1895896711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-00612310-0e0a-4a92-8d86-b35253a42493 tempest-ServersNegativeTestJSON-1895896711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:24 devstack sudo[90069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 01:59:24 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:25 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-00612310-0e0a-4a92-8d86-b35253a42493 tempest-ServersNegativeTestJSON-1895896711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.288s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:25 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-00612310-0e0a-4a92-8d86-b35253a42493 tempest-ServersNegativeTestJSON-1895896711 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:59:25 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-00612310-0e0a-4a92-8d86-b35253a42493 tempest-ServersNegativeTestJSON-1895896711 None] Deleted volume successfully. Sep 01 01:59:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-00612310-0e0a-4a92-8d86-b35253a42493 tempest-ServersNegativeTestJSON-1895896711 None] Lock "cinder-bc07daeb-2945-4a5d-99ef-d5bad70aed0c-delete_volume" released by "delete_volume" :: held 2.099s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7b9f12fa-b093-422e-9482-f57741b76ecb tempest-ServersNegativeTestJSON-1895896711 None] Acquiring lock "cinder-a14ab9a8-4b5f-462b-b57c-43c0fca5911d-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7b9f12fa-b093-422e-9482-f57741b76ecb tempest-ServersNegativeTestJSON-1895896711 None] Lock "cinder-a14ab9a8-4b5f-462b-b57c-43c0fca5911d-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7b9f12fa-b093-422e-9482-f57741b76ecb tempest-ServersNegativeTestJSON-1895896711 None] Acquiring lock "cinder-quobyte-a14ab9a8-4b5f-462b-b57c-43c0fca5911d" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7b9f12fa-b093-422e-9482-f57741b76ecb tempest-ServersNegativeTestJSON-1895896711 None] Lock "cinder-quobyte-a14ab9a8-4b5f-462b-b57c-43c0fca5911d" acquired by "delete_volume" :: waited 0.019s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:25 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e89a90f-71e4-487c-8d67-026fccb9cafa]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b9f12fa-b093-422e-9482-f57741b76ecb tempest-ServersNegativeTestJSON-1895896711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a14ab9a8-4b5f-462b-b57c-43c0fca5911d {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:25 devstack sudo[90087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a14ab9a8-4b5f-462b-b57c-43c0fca5911d Sep 01 01:59:25 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:26 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b9f12fa-b093-422e-9482-f57741b76ecb tempest-ServersNegativeTestJSON-1895896711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a14ab9a8-4b5f-462b-b57c-43c0fca5911d" returned: 0 in 0.534s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b9f12fa-b093-422e-9482-f57741b76ecb tempest-ServersNegativeTestJSON-1895896711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a14ab9a8-4b5f-462b-b57c-43c0fca5911d {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:26 devstack sudo[90113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a14ab9a8-4b5f-462b-b57c-43c0fca5911d Sep 01 01:59:26 devstack sudo[90113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:26 devstack sudo[90113]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b9f12fa-b093-422e-9482-f57741b76ecb tempest-ServersNegativeTestJSON-1895896711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a14ab9a8-4b5f-462b-b57c-43c0fca5911d" returned: 0 in 0.330s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:26 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7b9f12fa-b093-422e-9482-f57741b76ecb tempest-ServersNegativeTestJSON-1895896711 None] Lock "cinder-quobyte-a14ab9a8-4b5f-462b-b57c-43c0fca5911d" released by "delete_volume" :: held 0.944s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:26 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-7b9f12fa-b093-422e-9482-f57741b76ecb tempest-ServersNegativeTestJSON-1895896711 None] Created reservations ['6dbc02b7-5b77-4513-a217-a90dc22eaa9a', '374fadab-4b3e-4e4c-8ada-b2053134505f', '29516a5f-ed9b-4fd2-a50d-0cf19dc488c6', '6071b576-6fca-494d-ac60-3be2071c3cab'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:59:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7b9f12fa-b093-422e-9482-f57741b76ecb tempest-ServersNegativeTestJSON-1895896711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7b9f12fa-b093-422e-9482-f57741b76ecb tempest-ServersNegativeTestJSON-1895896711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:26 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7b9f12fa-b093-422e-9482-f57741b76ecb tempest-ServersNegativeTestJSON-1895896711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:26 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7b9f12fa-b093-422e-9482-f57741b76ecb tempest-ServersNegativeTestJSON-1895896711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7b9f12fa-b093-422e-9482-f57741b76ecb tempest-ServersNegativeTestJSON-1895896711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b9f12fa-b093-422e-9482-f57741b76ecb tempest-ServersNegativeTestJSON-1895896711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:26 devstack sudo[90131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 01:59:26 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:26 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-8117a906-79b0-4ed2-8936-943047d832cf req-831ef805-1cbe-4567-b1c0-a24eafd0c152 tempest-ServerActionsTestOtherA-1922255062 None] Terminate volume connection completed successfully. Sep 01 01:59:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-8117a906-79b0-4ed2-8936-943047d832cf req-831ef805-1cbe-4567-b1c0-a24eafd0c152 tempest-ServerActionsTestOtherA-1922255062 None] Deleting attachment 7bec93b1-19df-460b-818e-7eb016a1af5e. {{(pid=87128) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:59:27 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b9f12fa-b093-422e-9482-f57741b76ecb tempest-ServersNegativeTestJSON-1895896711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.385s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:27 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-7b9f12fa-b093-422e-9482-f57741b76ecb tempest-ServersNegativeTestJSON-1895896711 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:59:27 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-7b9f12fa-b093-422e-9482-f57741b76ecb tempest-ServersNegativeTestJSON-1895896711 None] Deleted volume successfully. Sep 01 01:59:27 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7b9f12fa-b093-422e-9482-f57741b76ecb tempest-ServersNegativeTestJSON-1895896711 None] Lock "cinder-a14ab9a8-4b5f-462b-b57c-43c0fca5911d-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-8117a906-79b0-4ed2-8936-943047d832cf req-fc37f35b-3237-4c93-bdb6-2807e9638697 tempest-ServerActionsTestOtherA-1922255062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-8117a906-79b0-4ed2-8936-943047d832cf req-fc37f35b-3237-4c93-bdb6-2807e9638697 tempest-ServerActionsTestOtherA-1922255062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-8117a906-79b0-4ed2-8936-943047d832cf req-fc37f35b-3237-4c93-bdb6-2807e9638697 tempest-ServerActionsTestOtherA-1922255062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-8117a906-79b0-4ed2-8936-943047d832cf req-fc37f35b-3237-4c93-bdb6-2807e9638697 tempest-ServerActionsTestOtherA-1922255062 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb', 'name': 'volume-7932ce89-cde7-4986-823e-7c0631d0b8ee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a63e639-b4d4-4736-b5a0-cabaa9d88e8e', 'enforce_multipath': True} {{(pid=87128) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:59:29 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-8117a906-79b0-4ed2-8936-943047d832cf req-fc37f35b-3237-4c93-bdb6-2807e9638697 tempest-ServerActionsTestOtherA-1922255062 None] attachment_update completed successfully. Sep 01 01:59:33 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:59:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] Flow 'volume_create_manager' (1066434e-ea30-4f2c-b340-4f8fc64bee92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:59:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c87e5158-1461-4e9e-bf7a-f7759e867eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c87e5158-1461-4e9e-bf7a-f7759e867eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1475956514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03a08c3-fb38-4380-8aec-5248dc4fbc22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b67697ecd974b73aadd37a104f76ab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:59:33Z,use_quota=True,user_id='75de39754a1e430ea572a8c2dfcce9a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05420740-0fbc-430d-bb5d-cae47587c3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05420740-0fbc-430d-bb5d-cae47587c3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506c3c3a-1167-4fb3-ba30-6c08b3ba7d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506c3c3a-1167-4fb3-ba30-6c08b3ba7d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f03a08c3-fb38-4380-8aec-5248dc4fbc22', 'volume_name': 'volume-f03a08c3-fb38-4380-8aec-5248dc4fbc22', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e059ce-cac9-423f-970c-14ae1a9fc55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e059ce-cac9-423f-970c-14ae1a9fc55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa61ee9d-69d5-4394-924c-51ce83b0041b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:33 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] Volume f03a08c3-fb38-4380-8aec-5248dc4fbc22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f03a08c3-fb38-4380-8aec-5248dc4fbc22', 'volume_size': 1} Sep 01 01:59:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1475956514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03a08c3-fb38-4380-8aec-5248dc4fbc22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b67697ecd974b73aadd37a104f76ab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:59:33Z,use_quota=True,user_id='75de39754a1e430ea572a8c2dfcce9a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:59:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] Creating volume f03a08c3-fb38-4380-8aec-5248dc4fbc22 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:59:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:59:33 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 01:59:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f03a08c3-fb38-4380-8aec-5248dc4fbc22 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:33 devstack sudo[90656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f03a08c3-fb38-4380-8aec-5248dc4fbc22 1073741824 Sep 01 01:59:33 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:35 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f03a08c3-fb38-4380-8aec-5248dc4fbc22 1073741824" returned: 0 in 1.559s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f03a08c3-fb38-4380-8aec-5248dc4fbc22 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:35 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f03a08c3-fb38-4380-8aec-5248dc4fbc22 Sep 01 01:59:35 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:36 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f03a08c3-fb38-4380-8aec-5248dc4fbc22" returned: 0 in 0.882s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:36 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] <== create_volume: return (2642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:59:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.647s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa61ee9d-69d5-4394-924c-51ce83b0041b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f03a08c3-fb38-4380-8aec-5248dc4fbc22', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e44d87c4-3e9f-4b3d-b85d-d99b840aa2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:36 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] Volume volume-f03a08c3-fb38-4380-8aec-5248dc4fbc22 (f03a08c3-fb38-4380-8aec-5248dc4fbc22): created successfully Sep 01 01:59:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e44d87c4-3e9f-4b3d-b85d-d99b840aa2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] Flow 'volume_create_manager' (1066434e-ea30-4f2c-b340-4f8fc64bee92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:59:36 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-fa6906ff-461b-404c-b2d8-edc5eac2db73 tempest-ServerRescueNegativeTestJSON-17413612 None] Created volume successfully. Sep 01 01:59:46 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:UPDATE=31,cinder:SELECT=29,cinder:DELETE=1,cinder:INSERT=6 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:59:46 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=31,cinder:INSERT=5,cinder:UPDATE=25,cinder:DELETE=4 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:59:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-479050d7-d291-4c04-9bd2-4a1b0d6fc23a tempest-ServerRescueNegativeTestJSON-17413612 None] Acquiring lock "cinder-f03a08c3-fb38-4380-8aec-5248dc4fbc22-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-479050d7-d291-4c04-9bd2-4a1b0d6fc23a tempest-ServerRescueNegativeTestJSON-17413612 None] Lock "cinder-f03a08c3-fb38-4380-8aec-5248dc4fbc22-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-479050d7-d291-4c04-9bd2-4a1b0d6fc23a tempest-ServerRescueNegativeTestJSON-17413612 None] Acquiring lock "cinder-quobyte-f03a08c3-fb38-4380-8aec-5248dc4fbc22" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-479050d7-d291-4c04-9bd2-4a1b0d6fc23a tempest-ServerRescueNegativeTestJSON-17413612 None] Lock "cinder-quobyte-f03a08c3-fb38-4380-8aec-5248dc4fbc22" acquired by "delete_volume" :: waited 0.023s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:46 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[022abea2-378b-4ec0-bf92-a3c36a4bd5d6]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-479050d7-d291-4c04-9bd2-4a1b0d6fc23a tempest-ServerRescueNegativeTestJSON-17413612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f03a08c3-fb38-4380-8aec-5248dc4fbc22 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:47 devstack sudo[90845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f03a08c3-fb38-4380-8aec-5248dc4fbc22 Sep 01 01:59:47 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:47 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-479050d7-d291-4c04-9bd2-4a1b0d6fc23a tempest-ServerRescueNegativeTestJSON-17413612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f03a08c3-fb38-4380-8aec-5248dc4fbc22" returned: 0 in 0.650s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-479050d7-d291-4c04-9bd2-4a1b0d6fc23a tempest-ServerRescueNegativeTestJSON-17413612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f03a08c3-fb38-4380-8aec-5248dc4fbc22 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:47 devstack sudo[90852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f03a08c3-fb38-4380-8aec-5248dc4fbc22 Sep 01 01:59:47 devstack sudo[90852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:47 devstack sudo[90852]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-479050d7-d291-4c04-9bd2-4a1b0d6fc23a tempest-ServerRescueNegativeTestJSON-17413612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f03a08c3-fb38-4380-8aec-5248dc4fbc22" returned: 0 in 0.396s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:48 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-479050d7-d291-4c04-9bd2-4a1b0d6fc23a tempest-ServerRescueNegativeTestJSON-17413612 None] Lock "cinder-quobyte-f03a08c3-fb38-4380-8aec-5248dc4fbc22" released by "delete_volume" :: held 1.150s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:48 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-479050d7-d291-4c04-9bd2-4a1b0d6fc23a tempest-ServerRescueNegativeTestJSON-17413612 None] Created reservations ['35e3cfdf-69ec-4a01-b7d7-960f7b8ba23d', 'd9780a18-9873-478b-8068-23afa27d96a2', '4e1987a3-9803-437e-9f1b-ad2ccbd22837', '3ea509aa-b974-4dba-8e18-6c4e867027ff'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:59:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-479050d7-d291-4c04-9bd2-4a1b0d6fc23a tempest-ServerRescueNegativeTestJSON-17413612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-479050d7-d291-4c04-9bd2-4a1b0d6fc23a tempest-ServerRescueNegativeTestJSON-17413612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:48 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-479050d7-d291-4c04-9bd2-4a1b0d6fc23a tempest-ServerRescueNegativeTestJSON-17413612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:48 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-479050d7-d291-4c04-9bd2-4a1b0d6fc23a tempest-ServerRescueNegativeTestJSON-17413612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-479050d7-d291-4c04-9bd2-4a1b0d6fc23a tempest-ServerRescueNegativeTestJSON-17413612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-479050d7-d291-4c04-9bd2-4a1b0d6fc23a tempest-ServerRescueNegativeTestJSON-17413612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:48 devstack sudo[90855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 01:59:48 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:48 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-479050d7-d291-4c04-9bd2-4a1b0d6fc23a tempest-ServerRescueNegativeTestJSON-17413612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.378s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:48 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-479050d7-d291-4c04-9bd2-4a1b0d6fc23a tempest-ServerRescueNegativeTestJSON-17413612 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:59:48 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-479050d7-d291-4c04-9bd2-4a1b0d6fc23a tempest-ServerRescueNegativeTestJSON-17413612 None] Deleted volume successfully. Sep 01 01:59:48 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-479050d7-d291-4c04-9bd2-4a1b0d6fc23a tempest-ServerRescueNegativeTestJSON-17413612 None] Lock "cinder-f03a08c3-fb38-4380-8aec-5248dc4fbc22-delete_volume" released by "delete_volume" :: held 2.007s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-befcf7e1-2854-4a9a-bef6-5917d20879b4 req-f018cfb8-b1f8-4fd9-a003-5910817ce259 tempest-TaggedAttachmentsTest-636050106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-befcf7e1-2854-4a9a-bef6-5917d20879b4 req-f018cfb8-b1f8-4fd9-a003-5910817ce259 tempest-TaggedAttachmentsTest-636050106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-befcf7e1-2854-4a9a-bef6-5917d20879b4 req-f018cfb8-b1f8-4fd9-a003-5910817ce259 tempest-TaggedAttachmentsTest-636050106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-befcf7e1-2854-4a9a-bef6-5917d20879b4 req-f018cfb8-b1f8-4fd9-a003-5910817ce259 tempest-TaggedAttachmentsTest-636050106 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb', 'name': 'volume-33d3fde3-6c08-440a-9b9d-ebba0bc3d0e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '56b6910b-2b81-497d-b0e3-82fa1e414643', 'enforce_multipath': True} {{(pid=87128) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:59:56 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-befcf7e1-2854-4a9a-bef6-5917d20879b4 req-f018cfb8-b1f8-4fd9-a003-5910817ce259 tempest-TaggedAttachmentsTest-636050106 None] attachment_update completed successfully. Sep 01 02:00:03 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-930fc919-426d-4ed6-89d6-715b1634cb95 req-7397b436-6c7b-4c37-bf13-5c806e44fbdd tempest-TaggedAttachmentsTest-636050106 None] Terminate volume connection completed successfully. Sep 01 02:00:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-930fc919-426d-4ed6-89d6-715b1634cb95 req-7397b436-6c7b-4c37-bf13-5c806e44fbdd tempest-TaggedAttachmentsTest-636050106 None] Deleting attachment 56b6910b-2b81-497d-b0e3-82fa1e414643. {{(pid=87128) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:00:06 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=12,cinder:INSERT=2,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:00:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-10022b0d-5037-4ea7-80d3-0887211793cd tempest-BackendsCapabilitiesAdminTestsJSON-1321826962 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.0156593322754, 'free_capacity_gb': 1774.0156593322754, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87128) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 02:00:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f9755cd7-a55c-4eb7-b48a-184e635ddf68 tempest-BackendsCapabilitiesAdminTestsJSON-1321826962 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.0156593322754, 'free_capacity_gb': 1774.0156593322754, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87128) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 02:00:13 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:UPDATE=8,cinder:SELECT=13,cinder:INSERT=2 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:00:15 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-28b06a2b-25ad-4fb4-9c74-8779703d216d req-015b5ce2-a715-4deb-9937-a6c8ebad589d tempest-ServerActionsTestOtherA-1922255062 None] Terminate volume connection completed successfully. Sep 01 02:00:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-28b06a2b-25ad-4fb4-9c74-8779703d216d req-015b5ce2-a715-4deb-9937-a6c8ebad589d tempest-ServerActionsTestOtherA-1922255062 None] Deleting attachment 6a63e639-b4d4-4736-b5a0-cabaa9d88e8e. {{(pid=87128) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:00:15 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bba49b79-19a2-41b9-941d-ba6f906fa4df tempest-TaggedAttachmentsTest-636050106 None] Acquiring lock "cinder-33d3fde3-6c08-440a-9b9d-ebba0bc3d0e9-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:16 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bba49b79-19a2-41b9-941d-ba6f906fa4df tempest-TaggedAttachmentsTest-636050106 None] Lock "cinder-33d3fde3-6c08-440a-9b9d-ebba0bc3d0e9-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:16 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bba49b79-19a2-41b9-941d-ba6f906fa4df tempest-TaggedAttachmentsTest-636050106 None] Acquiring lock "cinder-quobyte-33d3fde3-6c08-440a-9b9d-ebba0bc3d0e9" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:16 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bba49b79-19a2-41b9-941d-ba6f906fa4df tempest-TaggedAttachmentsTest-636050106 None] Lock "cinder-quobyte-33d3fde3-6c08-440a-9b9d-ebba0bc3d0e9" acquired by "delete_volume" :: waited 0.061s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:16 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed7e695-b17e-4127-89c2-e00fb0ab9088]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bba49b79-19a2-41b9-941d-ba6f906fa4df tempest-TaggedAttachmentsTest-636050106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-33d3fde3-6c08-440a-9b9d-ebba0bc3d0e9 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:16 devstack sudo[91234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-33d3fde3-6c08-440a-9b9d-ebba0bc3d0e9 Sep 01 02:00:16 devstack sudo[91234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:16 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:00:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:16 devstack sudo[91234]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bba49b79-19a2-41b9-941d-ba6f906fa4df tempest-TaggedAttachmentsTest-636050106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-33d3fde3-6c08-440a-9b9d-ebba0bc3d0e9" returned: 0 in 0.673s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bba49b79-19a2-41b9-941d-ba6f906fa4df tempest-TaggedAttachmentsTest-636050106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-33d3fde3-6c08-440a-9b9d-ebba0bc3d0e9 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:16 devstack sudo[91245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:00:16 devstack sudo[91245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:17 devstack sudo[91246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-33d3fde3-6c08-440a-9b9d-ebba0bc3d0e9 Sep 01 02:00:17 devstack sudo[91246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:17 devstack sudo[91245]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.507s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:17 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:00:17 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager._thread_info {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:00:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread count: 8 {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:00:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread info: [<_MainThread(MainThread, started 128688016527488)>, , , , , , , ] {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:00:17 devstack sudo[91246]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bba49b79-19a2-41b9-941d-ba6f906fa4df tempest-TaggedAttachmentsTest-636050106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-33d3fde3-6c08-440a-9b9d-ebba0bc3d0e9" returned: 0 in 0.857s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:17 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bba49b79-19a2-41b9-941d-ba6f906fa4df tempest-TaggedAttachmentsTest-636050106 None] Lock "cinder-quobyte-33d3fde3-6c08-440a-9b9d-ebba0bc3d0e9" released by "delete_volume" :: held 1.661s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:18 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-bba49b79-19a2-41b9-941d-ba6f906fa4df tempest-TaggedAttachmentsTest-636050106 None] Created reservations ['02d4272f-26b4-4ce6-b320-4afcdecd6dfe', '5e441c2b-1c56-410c-b3c0-fc2b1503e93b', '1963fb10-d9d5-4ee9-9251-8b8e299498a1', 'fd6b2fbb-cbfc-4d3e-97b3-b6313a6ddfdb'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:00:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-bba49b79-19a2-41b9-941d-ba6f906fa4df tempest-TaggedAttachmentsTest-636050106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-bba49b79-19a2-41b9-941d-ba6f906fa4df tempest-TaggedAttachmentsTest-636050106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-bba49b79-19a2-41b9-941d-ba6f906fa4df tempest-TaggedAttachmentsTest-636050106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-bba49b79-19a2-41b9-941d-ba6f906fa4df tempest-TaggedAttachmentsTest-636050106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-bba49b79-19a2-41b9-941d-ba6f906fa4df tempest-TaggedAttachmentsTest-636050106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bba49b79-19a2-41b9-941d-ba6f906fa4df tempest-TaggedAttachmentsTest-636050106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:18 devstack sudo[91277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:00:18 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:18 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-855898cc-bebe-45f6-a7bb-1232fcc12392 tempest-GroupSnapshotsTest-772471291 None] Group tempest-GroupSnapshotsTest-Group-1455871716: creating Sep 01 02:00:18 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bba49b79-19a2-41b9-941d-ba6f906fa4df tempest-TaggedAttachmentsTest-636050106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.485s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:18 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-bba49b79-19a2-41b9-941d-ba6f906fa4df tempest-TaggedAttachmentsTest-636050106 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:00:18 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-bba49b79-19a2-41b9-941d-ba6f906fa4df tempest-TaggedAttachmentsTest-636050106 None] Deleted volume successfully. Sep 01 02:00:18 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-855898cc-bebe-45f6-a7bb-1232fcc12392 tempest-GroupSnapshotsTest-772471291 None] Group tempest-GroupSnapshotsTest-Group-1455871716: created successfully Sep 01 02:00:18 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-855898cc-bebe-45f6-a7bb-1232fcc12392 tempest-GroupSnapshotsTest-772471291 None] Create group completed successfully. Sep 01 02:00:18 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bba49b79-19a2-41b9-941d-ba6f906fa4df tempest-TaggedAttachmentsTest-636050106 None] Lock "cinder-33d3fde3-6c08-440a-9b9d-ebba0bc3d0e9-delete_volume" released by "delete_volume" :: held 2.825s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:20 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:00:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] Flow 'volume_create_manager' (72711a2b-432e-447d-819e-eb1c5e994cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eaf8972-6c9b-4bf3-8c02-f21d85b3b1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eaf8972-6c9b-4bf3-8c02-f21d85b3b1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-919125482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=38653a69-cf4c-4842-8130-931cf3b371ac,host='devstack@QuobyteHD#QuobyteHD',id=137620cf-866a-4372-926d-44bddb85d2e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b0b9e0db9e84d03afbb82b02b63d321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:21Z,use_quota=True,user_id='eaa1d30d16124f3a984e586c2dab8bb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7cf84d40-33e0-4d31-b412-3db4c9616f32),volume_type_id=7cf84d40-33e0-4d31-b412-3db4c9616f32)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (401e0f23-ae92-408e-99ab-68400e5f8e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (401e0f23-ae92-408e-99ab-68400e5f8e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae8118d-4eed-4655-893c-f261daf7ed6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae8118d-4eed-4655-893c-f261daf7ed6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '137620cf-866a-4372-926d-44bddb85d2e7', 'volume_name': 'volume-137620cf-866a-4372-926d-44bddb85d2e7', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bae8598-5c95-4ba9-aff7-b5212db26ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bae8598-5c95-4ba9-aff7-b5212db26ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94aec6ae-bf17-4ec6-83f0-3555a1ffd8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:21 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] Volume 137620cf-866a-4372-926d-44bddb85d2e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-137620cf-866a-4372-926d-44bddb85d2e7', 'volume_size': 1} Sep 01 02:00:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=38653a69-cf4c-4842-8130-931cf3b371ac,created_at=2026-09-01T00:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-919125482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=38653a69-cf4c-4842-8130-931cf3b371ac,host='devstack@QuobyteHD#QuobyteHD',id=137620cf-866a-4372-926d-44bddb85d2e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b0b9e0db9e84d03afbb82b02b63d321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:21Z,use_quota=True,user_id='eaa1d30d16124f3a984e586c2dab8bb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7cf84d40-33e0-4d31-b412-3db4c9616f32),volume_type_id=7cf84d40-33e0-4d31-b412-3db4c9616f32)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:00:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] Creating volume 137620cf-866a-4372-926d-44bddb85d2e7 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:00:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:00:21 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:00:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:21 devstack sudo[91286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7 1073741824 Sep 01 02:00:21 devstack sudo[91286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:21 devstack sudo[91286]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7 1073741824" returned: 0 in 0.541s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:21 devstack sudo[91293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7 Sep 01 02:00:21 devstack sudo[91293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:22 devstack sudo[91293]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7" returned: 0 in 0.346s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:22 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:00:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:22 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94aec6ae-bf17-4ec6-83f0-3555a1ffd8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-137620cf-866a-4372-926d-44bddb85d2e7', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:22 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffed24e3-fc0a-4a21-a3d6-a04baddc790b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:22 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] Volume volume-137620cf-866a-4372-926d-44bddb85d2e7 (137620cf-866a-4372-926d-44bddb85d2e7): created successfully Sep 01 02:00:22 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffed24e3-fc0a-4a21-a3d6-a04baddc790b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:22 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] Flow 'volume_create_manager' (72711a2b-432e-447d-819e-eb1c5e994cb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:22 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-c6a98d9d-e810-4b1c-87c0-07bcbfe20d44 tempest-GroupSnapshotsTest-772471291 None] Created volume successfully. Sep 01 02:00:22 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-e5bdc761-7a0a-48cf-91ea-e444114103e2 tempest-GroupSnapshotsTest-772471291 None] GroupSnapshot 2e878ba5-d7e6-4a78-bad8-c8fc3877c3c0: creating. Sep 01 02:00:22 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e5bdc761-7a0a-48cf-91ea-e444114103e2 tempest-GroupSnapshotsTest-772471291 None] Group snapshot 2e878ba5-d7e6-4a78-bad8-c8fc3877c3c0: creating. {{(pid=87128) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 02:00:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e5bdc761-7a0a-48cf-91ea-e444114103e2 tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e5bdc761-7a0a-48cf-91ea-e444114103e2 tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:22 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-e5bdc761-7a0a-48cf-91ea-e444114103e2 tempest-GroupSnapshotsTest-772471291 None] Creating offline snapshot 0694f2ad-66e2-4cbe-8b23-49702cefabd3 of volume 137620cf-866a-4372-926d-44bddb85d2e7 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:00:23 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[df71d500-3989-4eca-8c15-f657d5e60ad6]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e5bdc761-7a0a-48cf-91ea-e444114103e2 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:23 devstack sudo[91301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7 Sep 01 02:00:23 devstack sudo[91301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:23 devstack sudo[91301]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e5bdc761-7a0a-48cf-91ea-e444114103e2 tempest-GroupSnapshotsTest-772471291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7" returned: 0 in 0.640s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e5bdc761-7a0a-48cf-91ea-e444114103e2 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7.0694f2ad-66e2-4cbe-8b23-49702cefabd3 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:23 devstack sudo[91306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7.0694f2ad-66e2-4cbe-8b23-49702cefabd3 1G Sep 01 02:00:23 devstack sudo[91306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:24 devstack sudo[91306]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e5bdc761-7a0a-48cf-91ea-e444114103e2 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7.0694f2ad-66e2-4cbe-8b23-49702cefabd3 1G" returned: 0 in 0.643s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e5bdc761-7a0a-48cf-91ea-e444114103e2 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-137620cf-866a-4372-926d-44bddb85d2e7 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7.0694f2ad-66e2-4cbe-8b23-49702cefabd3 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:24 devstack sudo[91314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-137620cf-866a-4372-926d-44bddb85d2e7 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7.0694f2ad-66e2-4cbe-8b23-49702cefabd3 Sep 01 02:00:24 devstack sudo[91314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:24 devstack sudo[91314]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e5bdc761-7a0a-48cf-91ea-e444114103e2 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-137620cf-866a-4372-926d-44bddb85d2e7 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7.0694f2ad-66e2-4cbe-8b23-49702cefabd3" returned: 0 in 0.290s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:24 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-e5bdc761-7a0a-48cf-91ea-e444114103e2 tempest-GroupSnapshotsTest-772471291 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7.0694f2ad-66e2-4cbe-8b23-49702cefabd3 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:00:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e5bdc761-7a0a-48cf-91ea-e444114103e2 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7.0694f2ad-66e2-4cbe-8b23-49702cefabd3 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:24 devstack sudo[91320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7.0694f2ad-66e2-4cbe-8b23-49702cefabd3 Sep 01 02:00:24 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:24 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e5bdc761-7a0a-48cf-91ea-e444114103e2 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7.0694f2ad-66e2-4cbe-8b23-49702cefabd3" returned: 0 in 0.338s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e5bdc761-7a0a-48cf-91ea-e444114103e2 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:25 devstack sudo[91325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7.info Sep 01 02:00:25 devstack sudo[91325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:25 devstack sudo[91325]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e5bdc761-7a0a-48cf-91ea-e444114103e2 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7.info" returned: 0 in 0.363s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:25 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-e5bdc761-7a0a-48cf-91ea-e444114103e2 tempest-GroupSnapshotsTest-772471291 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:00:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e5bdc761-7a0a-48cf-91ea-e444114103e2 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:25 devstack sudo[91328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7.info Sep 01 02:00:25 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:25 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:00:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Flow 'volume_create_manager' (382be62f-cc15-4762-88c0-d8f4c83aad87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb080196-212a-486f-96ac-ae902061ab11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb080196-212a-486f-96ac-ae902061ab11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1303274967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b718bb-36a0-4ac8-a202-77b2127c453a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d0ea659402b4827a795c4eadd9b9452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:26Z,use_quota=True,user_id='6571fc5019b946d1bd553a49f65dca89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33552032-9b27-4064-b844-98f5aa826a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33552032-9b27-4064-b844-98f5aa826a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:25 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79d7124d-adee-4c69-921f-b48868ee5d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:25 devstack cinder-volume[87128]: DEBUG cinder.image.glance [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Creating Keystone auth plugin from conf {{(pid=87128) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:00:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e5bdc761-7a0a-48cf-91ea-e444114103e2 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7.info" returned: 0 in 0.363s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e5bdc761-7a0a-48cf-91ea-e444114103e2 tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.810s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:25 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-e5bdc761-7a0a-48cf-91ea-e444114103e2 tempest-GroupSnapshotsTest-772471291 None] group_snapshot 2e878ba5-d7e6-4a78-bad8-c8fc3877c3c0: created successfully Sep 01 02:00:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79d7124d-adee-4c69-921f-b48868ee5d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e4b718bb-36a0-4ac8-a202-77b2127c453a', 'volume_name': 'volume-e4b718bb-36a0-4ac8-a202-77b2127c453a', 'volume_size': 1, 'image_id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64fc298b-4656-41e6-a52e-bd149cb491e9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0dbd8f0a33a74d5db3271102e89b70d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'created_at': datetime.datetime(2026, 8, 31, 23, 51, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 51, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64fc298b-4656-41e6-a52e-bd149cb491e9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b0f860-1225-4fe8-b049-161001e3fc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b0f860-1225-4fe8-b049-161001e3fc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb7a5d3-df6b-4205-9f2e-a82a5be6a6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:26 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Volume e4b718bb-36a0-4ac8-a202-77b2127c453a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e4b718bb-36a0-4ac8-a202-77b2127c453a', 'volume_size': 1, 'image_id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64fc298b-4656-41e6-a52e-bd149cb491e9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0dbd8f0a33a74d5db3271102e89b70d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'created_at': datetime.datetime(2026, 8, 31, 23, 51, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 51, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64fc298b-4656-41e6-a52e-bd149cb491e9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 02:00:26 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Trying to clone e4b718bb-36a0-4ac8-a202-77b2127c453a from image 64fc298b-4656-41e6-a52e-bd149cb491e9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/64fc298b-4656-41e6-a52e-bd149cb491e9', 'metadata': {}}]). {{(pid=87128) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:00:26 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9__xwddiy_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87128) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:00:26 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Image download 20.69 MB at 20.69 MB/s Sep 01 02:00:26 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[939e7feb-3ea5-4931-8fff-67a7bf98669c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9__xwddiy_devstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:27 devstack sudo[91359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9__xwddiy_devstack@QuobyteHD Sep 01 02:00:27 devstack sudo[91359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:27 devstack sudo[91359]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9__xwddiy_devstack@QuobyteHD" returned: 0 in 0.432s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:27 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Temporary image 64fc298b-4656-41e6-a52e-bd149cb491e9 is fetched for user 6571fc5019b946d1bd553a49f65dca89. {{(pid=87128) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:00:27 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a224ba-2733-402f-b224-98df9bbcc4a9]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9__xwddiy_devstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:27 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "cinder-quobyte-0694f2ad-66e2-4cbe-8b23-49702cefabd3-b84f5527-2dde-4db0-96f1-fcdd798bf56c" by "_create_volume_from_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:27 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Lock "cinder-quobyte-0694f2ad-66e2-4cbe-8b23-49702cefabd3-b84f5527-2dde-4db0-96f1-fcdd798bf56c" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Creating volume b84f5527-2dde-4db0-96f1-fcdd798bf56c from snapshot 0694f2ad-66e2-4cbe-8b23-49702cefabd3 {{(pid=87128) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:00:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:00:27 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "cinder-quobyte-b84f5527-2dde-4db0-96f1-fcdd798bf56c" by "_copy_volume_from_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:27 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Lock "cinder-quobyte-b84f5527-2dde-4db0-96f1-fcdd798bf56c" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] snapshot: 0694f2ad-66e2-4cbe-8b23-49702cefabd3, volume: b84f5527-2dde-4db0-96f1-fcdd798bf56c, {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:00:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:27 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d77e392-a57c-4ca1-959b-23ceaf1a38c1]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7.0694f2ad-66e2-4cbe-8b23-49702cefabd3 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:27 devstack sudo[91364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9__xwddiy_devstack@QuobyteHD Sep 01 02:00:27 devstack sudo[91364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:27 devstack sudo[91365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7.0694f2ad-66e2-4cbe-8b23-49702cefabd3 Sep 01 02:00:27 devstack sudo[91365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:28 devstack sudo[91365]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7.0694f2ad-66e2-4cbe-8b23-49702cefabd3" returned: 0 in 0.487s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:28 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-137620cf-866a-4372-926d-44bddb85d2e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:00:28 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cbd238-86ad-4876-a526-1ff9f84ae61f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:28 devstack sudo[91364]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9__xwddiy_devstack@QuobyteHD" returned: 0 in 0.716s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:28 devstack sudo[91375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7 Sep 01 02:00:28 devstack sudo[91375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:28 devstack sudo[91375]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7" returned: 0 in 0.470s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:28 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7 {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:00:28 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Creating direct copy from snapshot {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:00:28 devstack cinder-volume[87128]: DEBUG cinder.utils [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Path /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b84f5527-2dde-4db0-96f1-fcdd798bf56c not found in is_blk_device check {{(pid=87128) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:00:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b84f5527-2dde-4db0-96f1-fcdd798bf56c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:28 devstack sudo[91381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b84f5527-2dde-4db0-96f1-fcdd798bf56c Sep 01 02:00:28 devstack sudo[91381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:33 devstack sudo[91381]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b84f5527-2dde-4db0-96f1-fcdd798bf56c" returned: 0 in 5.178s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:33 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7, size 1024.00 MB, duration 5.18 sec, destination /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b84f5527-2dde-4db0-96f1-fcdd798bf56c {{(pid=87128) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:00:33 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Converted 1024.00 MB image at 197.72 MB/s Sep 01 02:00:33 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b84f5527-2dde-4db0-96f1-fcdd798bf56c is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:00:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b84f5527-2dde-4db0-96f1-fcdd798bf56c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:33 devstack sudo[91424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b84f5527-2dde-4db0-96f1-fcdd798bf56c Sep 01 02:00:33 devstack sudo[91424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:34 devstack sudo[91424]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b84f5527-2dde-4db0-96f1-fcdd798bf56c" returned: 0 in 0.284s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Lock "cinder-quobyte-b84f5527-2dde-4db0-96f1-fcdd798bf56c" released by "_copy_volume_from_snapshot" :: held 6.535s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Lock "cinder-quobyte-0694f2ad-66e2-4cbe-8b23-49702cefabd3-b84f5527-2dde-4db0-96f1-fcdd798bf56c" released by "_create_volume_from_snapshot" :: held 6.611s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.629s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.943s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:34 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1303274967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b718bb-36a0-4ac8-a202-77b2127c453a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d0ea659402b4827a795c4eadd9b9452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:26Z,use_quota=True,user_id='6571fc5019b946d1bd553a49f65dca89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:00:34 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Creating volume e4b718bb-36a0-4ac8-a202-77b2127c453a {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:00:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:34 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:34 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:34 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:00:34 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:00:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e4b718bb-36a0-4ac8-a202-77b2127c453a 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:34 devstack sudo[91427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e4b718bb-36a0-4ac8-a202-77b2127c453a 1073741824 Sep 01 02:00:34 devstack sudo[91427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:34 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-a8bef698-e125-46a1-9112-665d60da3022 tempest-GroupSnapshotsTest-772471291 None] Create group from source-snapshot-2e878ba5-d7e6-4a78-bad8-c8fc3877c3c0 completed successfully. Sep 01 02:00:34 devstack sudo[91427]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e4b718bb-36a0-4ac8-a202-77b2127c453a 1073741824" returned: 0 in 0.464s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e4b718bb-36a0-4ac8-a202-77b2127c453a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:34 devstack sudo[91433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e4b718bb-36a0-4ac8-a202-77b2127c453a Sep 01 02:00:34 devstack sudo[91433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:34 devstack sudo[91433]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e4b718bb-36a0-4ac8-a202-77b2127c453a" returned: 0 in 0.294s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:35 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:00:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:35 devstack cinder-volume[87128]: DEBUG cinder.volume.volume_utils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Attempting download of 64fc298b-4656-41e6-a52e-bd149cb491e9 ((None, [{'url': 'file:///opt/stack/data/glance/images/64fc298b-4656-41e6-a52e-bd149cb491e9', 'metadata': {}}])) to volume e4b718bb-36a0-4ac8-a202-77b2127c453a. {{(pid=87128) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:00:35 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8222f8a-4671-4075-b854-536a7346eea4]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_nfduhpna {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:35 devstack sudo[91437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_nfduhpna Sep 01 02:00:35 devstack sudo[91437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-63824364-3c1b-4540-9e77-ef647173e5fd tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "cinder-quobyte-b84f5527-2dde-4db0-96f1-fcdd798bf56c" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-63824364-3c1b-4540-9e77-ef647173e5fd tempest-GroupSnapshotsTest-772471291 None] Lock "cinder-quobyte-b84f5527-2dde-4db0-96f1-fcdd798bf56c" acquired by "delete_volume" :: waited 0.019s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:35 devstack sudo[91437]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_nfduhpna" returned: 0 in 0.378s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_nfduhpna {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:35 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[0379681a-405a-494d-9fad-c6a9bae08dfe]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-63824364-3c1b-4540-9e77-ef647173e5fd tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b84f5527-2dde-4db0-96f1-fcdd798bf56c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:35 devstack sudo[91441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_nfduhpna Sep 01 02:00:35 devstack sudo[91441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:35 devstack sudo[91442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b84f5527-2dde-4db0-96f1-fcdd798bf56c Sep 01 02:00:35 devstack sudo[91442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:35 devstack sudo[91441]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_nfduhpna" returned: 1 in 0.367s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_nfduhpna' failed. Not Retrying. {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:00:35 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72f182a-df1e-46e3-ad65-4f469ae5f453]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9__xwddiy_devstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:35 devstack sudo[91442]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-63824364-3c1b-4540-9e77-ef647173e5fd tempest-GroupSnapshotsTest-772471291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b84f5527-2dde-4db0-96f1-fcdd798bf56c" returned: 0 in 0.407s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-63824364-3c1b-4540-9e77-ef647173e5fd tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b84f5527-2dde-4db0-96f1-fcdd798bf56c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:35 devstack sudo[91451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b84f5527-2dde-4db0-96f1-fcdd798bf56c Sep 01 02:00:35 devstack sudo[91451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:36 devstack sudo[91450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9__xwddiy_devstack@QuobyteHD Sep 01 02:00:36 devstack sudo[91450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:36 devstack sudo[91451]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-63824364-3c1b-4540-9e77-ef647173e5fd tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b84f5527-2dde-4db0-96f1-fcdd798bf56c" returned: 0 in 0.291s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-63824364-3c1b-4540-9e77-ef647173e5fd tempest-GroupSnapshotsTest-772471291 None] Lock "cinder-quobyte-b84f5527-2dde-4db0-96f1-fcdd798bf56c" released by "delete_volume" :: held 0.768s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:36 devstack sudo[91450]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9__xwddiy_devstack@QuobyteHD" returned: 0 in 0.402s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:36 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] 64fc298b-4656-41e6-a52e-bd149cb491e9 was qcow2, converting to qcow2 {{(pid=87128) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:00:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9__xwddiy_devstack@QuobyteHD /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e4b718bb-36a0-4ac8-a202-77b2127c453a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:36 devstack sudo[91458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9__xwddiy_devstack@QuobyteHD /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e4b718bb-36a0-4ac8-a202-77b2127c453a Sep 01 02:00:36 devstack sudo[91458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:36 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-63824364-3c1b-4540-9e77-ef647173e5fd tempest-GroupSnapshotsTest-772471291 None] Created reservations ['aa1983e7-88a2-4cf2-9431-cb6544c8b51d'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:00:36 devstack cinder-volume[87128]: WARNING cinder.quota [None req-63824364-3c1b-4540-9e77-ef647173e5fd tempest-GroupSnapshotsTest-772471291 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-395060309 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-395060309, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:00:36 devstack cinder-volume[87128]: WARNING cinder.quota [None req-63824364-3c1b-4540-9e77-ef647173e5fd tempest-GroupSnapshotsTest-772471291 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-395060309 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-395060309, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:00:36 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-63824364-3c1b-4540-9e77-ef647173e5fd tempest-GroupSnapshotsTest-772471291 None] Created reservations ['10ea016e-0a76-4dc3-b58e-53d47fdf457d', 'a7824e3f-5e81-4db5-874b-632b8c587e9d', '8ee57f6c-81b5-4c1a-96dd-9015c3e4658c', '0ab3f74a-df31-42b0-8702-17e9f830e8c3'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:00:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-63824364-3c1b-4540-9e77-ef647173e5fd tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-63824364-3c1b-4540-9e77-ef647173e5fd tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:36 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-63824364-3c1b-4540-9e77-ef647173e5fd tempest-GroupSnapshotsTest-772471291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:36 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-63824364-3c1b-4540-9e77-ef647173e5fd tempest-GroupSnapshotsTest-772471291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-63824364-3c1b-4540-9e77-ef647173e5fd tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-63824364-3c1b-4540-9e77-ef647173e5fd tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:36 devstack sudo[91463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:00:36 devstack sudo[91463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:36 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-208f56a1-9484-4018-a773-de22434a89ba tempest-GroupSnapshotsTest-772471291 None] group_snapshot 2e878ba5-d7e6-4a78-bad8-c8fc3877c3c0: deleting Sep 01 02:00:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-208f56a1-9484-4018-a773-de22434a89ba tempest-GroupSnapshotsTest-772471291 None] group_snapshot 2e878ba5-d7e6-4a78-bad8-c8fc3877c3c0: deleting {{(pid=87128) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 02:00:36 devstack sudo[91463]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-63824364-3c1b-4540-9e77-ef647173e5fd tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.365s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:36 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-63824364-3c1b-4540-9e77-ef647173e5fd tempest-GroupSnapshotsTest-772471291 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:00:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-208f56a1-9484-4018-a773-de22434a89ba tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "cinder-quobyte-137620cf-866a-4372-926d-44bddb85d2e7" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:36 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-63824364-3c1b-4540-9e77-ef647173e5fd tempest-GroupSnapshotsTest-772471291 None] Delete group completed successfully. Sep 01 02:00:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-208f56a1-9484-4018-a773-de22434a89ba tempest-GroupSnapshotsTest-772471291 None] Lock "cinder-quobyte-137620cf-866a-4372-926d-44bddb85d2e7" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-208f56a1-9484-4018-a773-de22434a89ba tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "cinder-quobyte-0694f2ad-66e2-4cbe-8b23-49702cefabd3" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-208f56a1-9484-4018-a773-de22434a89ba tempest-GroupSnapshotsTest-772471291 None] Lock "cinder-quobyte-0694f2ad-66e2-4cbe-8b23-49702cefabd3" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:36 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-208f56a1-9484-4018-a773-de22434a89ba tempest-GroupSnapshotsTest-772471291 None] Deleting offline snapshot 0694f2ad-66e2-4cbe-8b23-49702cefabd3 of volume 137620cf-866a-4372-926d-44bddb85d2e7 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:00:36 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-208f56a1-9484-4018-a773-de22434a89ba tempest-GroupSnapshotsTest-772471291 None] snapshot_file for this snap is: volume-137620cf-866a-4372-926d-44bddb85d2e7.0694f2ad-66e2-4cbe-8b23-49702cefabd3 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:00:36 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e67b17b-ace3-41e8-bcf5-679463d52394]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-208f56a1-9484-4018-a773-de22434a89ba tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7.0694f2ad-66e2-4cbe-8b23-49702cefabd3 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:37 devstack sudo[91476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7.0694f2ad-66e2-4cbe-8b23-49702cefabd3 Sep 01 02:00:37 devstack sudo[91476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:37 devstack sudo[91476]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-208f56a1-9484-4018-a773-de22434a89ba tempest-GroupSnapshotsTest-772471291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7.0694f2ad-66e2-4cbe-8b23-49702cefabd3" returned: 0 in 0.491s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:37 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-208f56a1-9484-4018-a773-de22434a89ba tempest-GroupSnapshotsTest-772471291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-137620cf-866a-4372-926d-44bddb85d2e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:00:37 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2bb010-afb5-4ac2-9d81-76570b3fd522]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-208f56a1-9484-4018-a773-de22434a89ba tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:37 devstack sudo[91486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7 Sep 01 02:00:37 devstack sudo[91486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:38 devstack sudo[91486]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-208f56a1-9484-4018-a773-de22434a89ba tempest-GroupSnapshotsTest-772471291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7" returned: 0 in 0.807s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-208f56a1-9484-4018-a773-de22434a89ba tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7.0694f2ad-66e2-4cbe-8b23-49702cefabd3 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:38 devstack sudo[91501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7.0694f2ad-66e2-4cbe-8b23-49702cefabd3 Sep 01 02:00:38 devstack sudo[91501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:38 devstack sudo[91501]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-208f56a1-9484-4018-a773-de22434a89ba tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7.0694f2ad-66e2-4cbe-8b23-49702cefabd3" returned: 0 in 0.471s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-208f56a1-9484-4018-a773-de22434a89ba tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7.0694f2ad-66e2-4cbe-8b23-49702cefabd3 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:38 devstack sudo[91506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7.0694f2ad-66e2-4cbe-8b23-49702cefabd3 Sep 01 02:00:38 devstack sudo[91506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:38 devstack sudo[91458]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9__xwddiy_devstack@QuobyteHD /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e4b718bb-36a0-4ac8-a202-77b2127c453a" returned: 0 in 2.581s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:38 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9__xwddiy_devstack@QuobyteHD, size 112.00 MB, duration 2.58 sec, destination /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e4b718bb-36a0-4ac8-a202-77b2127c453a {{(pid=87128) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:00:38 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Converted 112.00 MB image at 43.36 MB/s Sep 01 02:00:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e4b718bb-36a0-4ac8-a202-77b2127c453a 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:38 devstack sudo[91508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e4b718bb-36a0-4ac8-a202-77b2127c453a 1G Sep 01 02:00:38 devstack sudo[91508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:39 devstack sudo[91506]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-208f56a1-9484-4018-a773-de22434a89ba tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7.0694f2ad-66e2-4cbe-8b23-49702cefabd3" returned: 0 in 0.351s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:39 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-208f56a1-9484-4018-a773-de22434a89ba tempest-GroupSnapshotsTest-772471291 None] Lock "cinder-quobyte-0694f2ad-66e2-4cbe-8b23-49702cefabd3" released by "_delete_snapshot" :: held 2.229s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:39 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-208f56a1-9484-4018-a773-de22434a89ba tempest-GroupSnapshotsTest-772471291 None] Lock "cinder-quobyte-137620cf-866a-4372-926d-44bddb85d2e7" released by "delete_snapshot" :: held 2.260s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:39 devstack cinder-volume[87128]: WARNING cinder.quota [None req-208f56a1-9484-4018-a773-de22434a89ba tempest-GroupSnapshotsTest-772471291 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-395060309 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-395060309, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:00:39 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-208f56a1-9484-4018-a773-de22434a89ba tempest-GroupSnapshotsTest-772471291 None] Created reservations ['3e137492-2d03-4779-ad52-a23bb2a4b32b', 'a07c4f12-1ed4-4db5-943f-57380d79c47a', '98ed81fe-9e90-4aea-a1b5-de7c6e16205b', '95f87bed-15dd-4496-bad1-8c2ae689555f'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:00:39 devstack sudo[91508]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e4b718bb-36a0-4ac8-a202-77b2127c453a 1G" returned: 0 in 0.418s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:39 devstack cinder-volume[87128]: DEBUG cinder.volume.volume_utils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Downloaded image 64fc298b-4656-41e6-a52e-bd149cb491e9 ((None, [{'url': 'file:///opt/stack/data/glance/images/64fc298b-4656-41e6-a52e-bd149cb491e9', 'metadata': {}}])) to volume e4b718bb-36a0-4ac8-a202-77b2127c453a successfully. {{(pid=87128) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:00:39 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Temporary image 64fc298b-4656-41e6-a52e-bd149cb491e9 for user 6571fc5019b946d1bd553a49f65dca89 is deleted. {{(pid=87128) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:00:39 devstack cinder-volume[87128]: DEBUG cinder.volume.volume_utils [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Marking volume e4b718bb-36a0-4ac8-a202-77b2127c453a as bootable. {{(pid=87128) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:00:39 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Copying metadata from image 64fc298b-4656-41e6-a52e-bd149cb491e9 to e4b718bb-36a0-4ac8-a202-77b2127c453a. {{(pid=87128) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:00:39 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Creating volume glance metadata for volume e4b718bb-36a0-4ac8-a202-77b2127c453a backed by image 64fc298b-4656-41e6-a52e-bd149cb491e9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87128) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:00:39 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-208f56a1-9484-4018-a773-de22434a89ba tempest-GroupSnapshotsTest-772471291 None] group_snapshot 2e878ba5-d7e6-4a78-bad8-c8fc3877c3c0: deleted successfully Sep 01 02:00:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb7a5d3-df6b-4205-9f2e-a82a5be6a6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4b718bb-36a0-4ac8-a202-77b2127c453a', 'volume_size': 1, 'image_id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64fc298b-4656-41e6-a52e-bd149cb491e9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0dbd8f0a33a74d5db3271102e89b70d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'created_at': datetime.datetime(2026, 8, 31, 23, 51, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 51, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64fc298b-4656-41e6-a52e-bd149cb491e9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76db9fe4-1249-4aec-873e-b05a733b3bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:39 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Volume volume-e4b718bb-36a0-4ac8-a202-77b2127c453a (e4b718bb-36a0-4ac8-a202-77b2127c453a): created successfully Sep 01 02:00:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76db9fe4-1249-4aec-873e-b05a733b3bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Flow 'volume_create_manager' (382be62f-cc15-4762-88c0-d8f4c83aad87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:39 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-babde8c4-4724-4cc9-bb87-f9554abde781 tempest-ServerActionsTestOtherA-1922255062 None] Created volume successfully. Sep 01 02:00:40 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:00:40 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] Flow 'volume_create_manager' (6003e107-a534-4909-a146-d909faeef9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:40 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6883e61-d7b0-415f-9755-73d1e9e13146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:40 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6883e61-d7b0-415f-9755-73d1e9e13146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-604844436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7968c2e-72eb-4382-8e54-0420a1f94485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831074702da24178948df9291c8f3e46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:40Z,use_quota=True,user_id='a4dc288dee1d4f86a1feaca01fd66ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:40 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a163499e-3db2-4498-b9e7-777a2020f4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:40 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a163499e-3db2-4498-b9e7-777a2020f4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:40 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dbfe296-7d4a-4707-a64a-231f4776c6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:40 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dbfe296-7d4a-4707-a64a-231f4776c6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7968c2e-72eb-4382-8e54-0420a1f94485', 'volume_name': 'volume-c7968c2e-72eb-4382-8e54-0420a1f94485', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:40 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e0679e0-d7f8-4e14-8399-5da28c393526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:40 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e0679e0-d7f8-4e14-8399-5da28c393526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:40 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e4e7d37-c8ea-4411-9d5a-3f545e35865e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:40 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] Volume c7968c2e-72eb-4382-8e54-0420a1f94485: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7968c2e-72eb-4382-8e54-0420a1f94485', 'volume_size': 1} Sep 01 02:00:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:40 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-604844436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7968c2e-72eb-4382-8e54-0420a1f94485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831074702da24178948df9291c8f3e46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:40Z,use_quota=True,user_id='a4dc288dee1d4f86a1feaca01fd66ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:00:40 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] Creating volume c7968c2e-72eb-4382-8e54-0420a1f94485 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:00:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:40 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:40 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:40 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:00:40 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:00:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:40 devstack sudo[91514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485 1073741824 Sep 01 02:00:40 devstack sudo[91514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:40 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-eb510481-1519-46ca-a816-949169e68dfb tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "cinder-quobyte-137620cf-866a-4372-926d-44bddb85d2e7" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:40 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-eb510481-1519-46ca-a816-949169e68dfb tempest-GroupSnapshotsTest-772471291 None] Lock "cinder-quobyte-137620cf-866a-4372-926d-44bddb85d2e7" acquired by "delete_volume" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:40 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[25781669-202b-4c84-9548-97e0880fb889]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eb510481-1519-46ca-a816-949169e68dfb tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:40 devstack sudo[91514]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485 1073741824" returned: 0 in 0.536s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:40 devstack sudo[91521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485 Sep 01 02:00:40 devstack sudo[91521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:40 devstack sudo[91520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7 Sep 01 02:00:40 devstack sudo[91520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:41 devstack sudo[91521]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485" returned: 0 in 0.311s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:00:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e4e7d37-c8ea-4411-9d5a-3f545e35865e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7968c2e-72eb-4382-8e54-0420a1f94485', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9d04c43-b6b5-46f8-89dd-ea5d4e5cdc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:41 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] Volume volume-c7968c2e-72eb-4382-8e54-0420a1f94485 (c7968c2e-72eb-4382-8e54-0420a1f94485): created successfully Sep 01 02:00:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9d04c43-b6b5-46f8-89dd-ea5d4e5cdc96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] Flow 'volume_create_manager' (6003e107-a534-4909-a146-d909faeef9bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:41 devstack sudo[91520]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eb510481-1519-46ca-a816-949169e68dfb tempest-GroupSnapshotsTest-772471291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7" returned: 0 in 0.455s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eb510481-1519-46ca-a816-949169e68dfb tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:41 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-ec295a04-33f5-4bcd-ad21-57adbb6895a8 req-ae377973-a040-47be-a08d-c0c4abe747e9 tempest-VolumesSnapshotsTestJSON-2127590053 None] Created volume successfully. Sep 01 02:00:41 devstack sudo[91529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7 Sep 01 02:00:41 devstack sudo[91529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:41 devstack sudo[91529]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eb510481-1519-46ca-a816-949169e68dfb tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-137620cf-866a-4372-926d-44bddb85d2e7" returned: 0 in 0.282s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:41 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-eb510481-1519-46ca-a816-949169e68dfb tempest-GroupSnapshotsTest-772471291 None] Lock "cinder-quobyte-137620cf-866a-4372-926d-44bddb85d2e7" released by "delete_volume" :: held 0.803s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:41 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-eb510481-1519-46ca-a816-949169e68dfb tempest-GroupSnapshotsTest-772471291 None] Created reservations ['52f9c0a1-a059-49b5-a152-9921c29a19f5'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:00:41 devstack cinder-volume[87128]: WARNING cinder.db.api [None req-eb510481-1519-46ca-a816-949169e68dfb tempest-GroupSnapshotsTest-772471291 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-395060309'] Sep 01 02:00:41 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-eb510481-1519-46ca-a816-949169e68dfb tempest-GroupSnapshotsTest-772471291 None] Created reservations ['6d7abedd-5434-4ab5-b13e-2f9bb45eafd8', 'ffe21e39-3b41-48fc-a37e-fda4c397fa53', 'b4026a5c-c345-46b3-a507-e0e21be9adfa', 'ee3df107-2042-4c22-aa29-27c0de02a453'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:00:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-eb510481-1519-46ca-a816-949169e68dfb tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-eb510481-1519-46ca-a816-949169e68dfb tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-eb510481-1519-46ca-a816-949169e68dfb tempest-GroupSnapshotsTest-772471291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-eb510481-1519-46ca-a816-949169e68dfb tempest-GroupSnapshotsTest-772471291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-eb510481-1519-46ca-a816-949169e68dfb tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eb510481-1519-46ca-a816-949169e68dfb tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:41 devstack sudo[91535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:00:41 devstack sudo[91535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:41 devstack sudo[91535]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eb510481-1519-46ca-a816-949169e68dfb tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.273s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:41 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-eb510481-1519-46ca-a816-949169e68dfb tempest-GroupSnapshotsTest-772471291 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:00:41 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-eb510481-1519-46ca-a816-949169e68dfb tempest-GroupSnapshotsTest-772471291 None] Delete group completed successfully. Sep 01 02:00:42 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-2ad0605e-bc17-44ed-8309-e06cdea3da61 tempest-GroupSnapshotsTest-772471291 None] Group tempest-GroupSnapshotsTest-Group-1075225871: creating Sep 01 02:00:42 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-2ad0605e-bc17-44ed-8309-e06cdea3da61 tempest-GroupSnapshotsTest-772471291 None] Group tempest-GroupSnapshotsTest-Group-1075225871: created successfully Sep 01 02:00:42 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-2ad0605e-bc17-44ed-8309-e06cdea3da61 tempest-GroupSnapshotsTest-772471291 None] Create group completed successfully. Sep 01 02:00:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-df9b1188-36ae-42a8-b1c7-437991eb7697 req-ad8fa002-3716-4fd5-bd8c-6c86e352e3d8 tempest-VolumesSnapshotsTestJSON-2127590053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-df9b1188-36ae-42a8-b1c7-437991eb7697 req-ad8fa002-3716-4fd5-bd8c-6c86e352e3d8 tempest-VolumesSnapshotsTestJSON-2127590053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [req-df9b1188-36ae-42a8-b1c7-437991eb7697 req-ad8fa002-3716-4fd5-bd8c-6c86e352e3d8 tempest-VolumesSnapshotsTestJSON-2127590053 None] Creating offline snapshot 316aa381-447b-4aaf-baa1-df2784910111 of volume c7968c2e-72eb-4382-8e54-0420a1f94485 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:00:42 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0be5382-a652-40a3-85db-297f39bfb743]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-df9b1188-36ae-42a8-b1c7-437991eb7697 req-ad8fa002-3716-4fd5-bd8c-6c86e352e3d8 tempest-VolumesSnapshotsTestJSON-2127590053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:43 devstack sudo[91541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485 Sep 01 02:00:43 devstack sudo[91541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:43 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:00:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] Flow 'volume_create_manager' (7f42923d-5624-4540-b3dd-e289e28d7b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (706bcd7c-dd36-402c-8086-c31d8ca2cea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (706bcd7c-dd36-402c-8086-c31d8ca2cea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1956422068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61d13d43-22d6-4ae1-b9bc-17c7b8f06b73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce0bfde136c04957879b4232edb8f530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:43Z,use_quota=True,user_id='378035cd106849a6a3f502748ea83782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (772f14eb-4431-44ae-b118-3539fce39b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (772f14eb-4431-44ae-b118-3539fce39b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e587fb-0b0f-48be-86de-c17d8e9e3960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e587fb-0b0f-48be-86de-c17d8e9e3960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61d13d43-22d6-4ae1-b9bc-17c7b8f06b73', 'volume_name': 'volume-61d13d43-22d6-4ae1-b9bc-17c7b8f06b73', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d96f95-ccbe-42d6-90a5-adaa3c6a625b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d96f95-ccbe-42d6-90a5-adaa3c6a625b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dfd42eb-58d7-4347-9a56-af0b2c805729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:43 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] Volume 61d13d43-22d6-4ae1-b9bc-17c7b8f06b73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61d13d43-22d6-4ae1-b9bc-17c7b8f06b73', 'volume_size': 1} Sep 01 02:00:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:43 devstack sudo[91541]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-df9b1188-36ae-42a8-b1c7-437991eb7697 req-ad8fa002-3716-4fd5-bd8c-6c86e352e3d8 tempest-VolumesSnapshotsTestJSON-2127590053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485" returned: 0 in 0.680s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-df9b1188-36ae-42a8-b1c7-437991eb7697 req-ad8fa002-3716-4fd5-bd8c-6c86e352e3d8 tempest-VolumesSnapshotsTestJSON-2127590053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485.316aa381-447b-4aaf-baa1-df2784910111 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:43 devstack sudo[91554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485.316aa381-447b-4aaf-baa1-df2784910111 1G Sep 01 02:00:43 devstack sudo[91554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-bf7d98f1-3c8a-4520-91c3-fede7144f4dc req-23a7004f-5412-45d3-8666-063398c91b8a tempest-ServerActionsTestOtherA-1922255062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:43 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:00:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] Flow 'volume_create_manager' (c545a92b-f8c4-4838-b478-2f84f26b7f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9526bf42-1bf1-4093-b7f8-8e2894cb37f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9526bf42-1bf1-4093-b7f8-8e2894cb37f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-821816247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d4e53dc1-8863-4ab2-b8ba-ee2f8f2a763a,host='devstack@QuobyteHD#QuobyteHD',id=a222a766-c2e4-4561-8c0f-caa120341b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b0b9e0db9e84d03afbb82b02b63d321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:44Z,use_quota=True,user_id='eaa1d30d16124f3a984e586c2dab8bb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f2a00af-74a9-4817-a64a-47fe6729ea65),volume_type_id=0f2a00af-74a9-4817-a64a-47fe6729ea65)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed709092-c45f-44bc-8946-95b5c831eb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed709092-c45f-44bc-8946-95b5c831eb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (500c7573-24ec-49d4-a5c6-bb84d21a5436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (500c7573-24ec-49d4-a5c6-bb84d21a5436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a222a766-c2e4-4561-8c0f-caa120341b20', 'volume_name': 'volume-a222a766-c2e4-4561-8c0f-caa120341b20', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e79f07-5efb-46d8-ab41-1e573e6b6415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e79f07-5efb-46d8-ab41-1e573e6b6415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b10f03-0c4d-4b65-bb85-1fa6f15de87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:43 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] Volume a222a766-c2e4-4561-8c0f-caa120341b20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a222a766-c2e4-4561-8c0f-caa120341b20', 'volume_size': 1} Sep 01 02:00:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:44 devstack sudo[91554]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-df9b1188-36ae-42a8-b1c7-437991eb7697 req-ad8fa002-3716-4fd5-bd8c-6c86e352e3d8 tempest-VolumesSnapshotsTestJSON-2127590053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485.316aa381-447b-4aaf-baa1-df2784910111 1G" returned: 0 in 0.578s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-df9b1188-36ae-42a8-b1c7-437991eb7697 req-ad8fa002-3716-4fd5-bd8c-6c86e352e3d8 tempest-VolumesSnapshotsTestJSON-2127590053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7968c2e-72eb-4382-8e54-0420a1f94485 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485.316aa381-447b-4aaf-baa1-df2784910111 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:44 devstack sudo[91560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7968c2e-72eb-4382-8e54-0420a1f94485 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485.316aa381-447b-4aaf-baa1-df2784910111 Sep 01 02:00:44 devstack sudo[91560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:44 devstack sudo[91560]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-df9b1188-36ae-42a8-b1c7-437991eb7697 req-ad8fa002-3716-4fd5-bd8c-6c86e352e3d8 tempest-VolumesSnapshotsTestJSON-2127590053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7968c2e-72eb-4382-8e54-0420a1f94485 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485.316aa381-447b-4aaf-baa1-df2784910111" returned: 0 in 0.318s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:44 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [req-df9b1188-36ae-42a8-b1c7-437991eb7697 req-ad8fa002-3716-4fd5-bd8c-6c86e352e3d8 tempest-VolumesSnapshotsTestJSON-2127590053 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485.316aa381-447b-4aaf-baa1-df2784910111 is being set with open permissions: ugo+rw Sep 01 02:00:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-df9b1188-36ae-42a8-b1c7-437991eb7697 req-ad8fa002-3716-4fd5-bd8c-6c86e352e3d8 tempest-VolumesSnapshotsTestJSON-2127590053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485.316aa381-447b-4aaf-baa1-df2784910111 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:44 devstack sudo[91566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485.316aa381-447b-4aaf-baa1-df2784910111 Sep 01 02:00:44 devstack sudo[91566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:44 devstack sudo[91566]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-df9b1188-36ae-42a8-b1c7-437991eb7697 req-ad8fa002-3716-4fd5-bd8c-6c86e352e3d8 tempest-VolumesSnapshotsTestJSON-2127590053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485.316aa381-447b-4aaf-baa1-df2784910111" returned: 0 in 0.235s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-df9b1188-36ae-42a8-b1c7-437991eb7697 req-ad8fa002-3716-4fd5-bd8c-6c86e352e3d8 tempest-VolumesSnapshotsTestJSON-2127590053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:44 devstack sudo[91569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485.info Sep 01 02:00:44 devstack sudo[91569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:44 devstack sudo[91569]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-df9b1188-36ae-42a8-b1c7-437991eb7697 req-ad8fa002-3716-4fd5-bd8c-6c86e352e3d8 tempest-VolumesSnapshotsTestJSON-2127590053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485.info" returned: 0 in 0.281s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:44 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [req-df9b1188-36ae-42a8-b1c7-437991eb7697 req-ad8fa002-3716-4fd5-bd8c-6c86e352e3d8 tempest-VolumesSnapshotsTestJSON-2127590053 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485.info is being set with open permissions: ugo+rw Sep 01 02:00:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-df9b1188-36ae-42a8-b1c7-437991eb7697 req-ad8fa002-3716-4fd5-bd8c-6c86e352e3d8 tempest-VolumesSnapshotsTestJSON-2127590053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:44 devstack sudo[91572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485.info Sep 01 02:00:44 devstack sudo[91572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:45 devstack sudo[91572]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-df9b1188-36ae-42a8-b1c7-437991eb7697 req-ad8fa002-3716-4fd5-bd8c-6c86e352e3d8 tempest-VolumesSnapshotsTestJSON-2127590053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485.info" returned: 0 in 0.292s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-df9b1188-36ae-42a8-b1c7-437991eb7697 req-ad8fa002-3716-4fd5-bd8c-6c86e352e3d8 tempest-VolumesSnapshotsTestJSON-2127590053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.525s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.937s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:45 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1956422068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61d13d43-22d6-4ae1-b9bc-17c7b8f06b73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce0bfde136c04957879b4232edb8f530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:43Z,use_quota=True,user_id='378035cd106849a6a3f502748ea83782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:00:45 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] Creating volume 61d13d43-22d6-4ae1-b9bc-17c7b8f06b73 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:00:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:45 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:45 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:45 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:00:45 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:00:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-61d13d43-22d6-4ae1-b9bc-17c7b8f06b73 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:45 devstack sudo[91575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-61d13d43-22d6-4ae1-b9bc-17c7b8f06b73 1073741824 Sep 01 02:00:45 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:45 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-df9b1188-36ae-42a8-b1c7-437991eb7697 req-ad8fa002-3716-4fd5-bd8c-6c86e352e3d8 tempest-VolumesSnapshotsTestJSON-2127590053 None] Create snapshot completed successfully Sep 01 02:00:45 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-61d13d43-22d6-4ae1-b9bc-17c7b8f06b73 1073741824" returned: 0 in 0.482s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-61d13d43-22d6-4ae1-b9bc-17c7b8f06b73 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:45 devstack sudo[91583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-61d13d43-22d6-4ae1-b9bc-17c7b8f06b73 Sep 01 02:00:45 devstack sudo[91583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:46 devstack sudo[91583]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-61d13d43-22d6-4ae1-b9bc-17c7b8f06b73" returned: 0 in 0.257s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-bf7d98f1-3c8a-4520-91c3-fede7144f4dc req-23a7004f-5412-45d3-8666-063398c91b8a tempest-ServerActionsTestOtherA-1922255062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.487s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-bf7d98f1-3c8a-4520-91c3-fede7144f4dc req-23a7004f-5412-45d3-8666-063398c91b8a tempest-ServerActionsTestOtherA-1922255062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.265s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d4e53dc1-8863-4ab2-b8ba-ee2f8f2a763a,created_at=2026-09-01T00:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-821816247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d4e53dc1-8863-4ab2-b8ba-ee2f8f2a763a,host='devstack@QuobyteHD#QuobyteHD',id=a222a766-c2e4-4561-8c0f-caa120341b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b0b9e0db9e84d03afbb82b02b63d321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:44Z,use_quota=True,user_id='eaa1d30d16124f3a984e586c2dab8bb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f2a00af-74a9-4817-a64a-47fe6729ea65),volume_type_id=0f2a00af-74a9-4817-a64a-47fe6729ea65)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] Creating volume a222a766-c2e4-4561-8c0f-caa120341b20 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:00:46 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dfd42eb-58d7-4347-9a56-af0b2c805729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61d13d43-22d6-4ae1-b9bc-17c7b8f06b73', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827180d3-b1db-4b9d-8849-8ea674f8d2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:46 devstack sudo[91586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20 1073741824 Sep 01 02:00:46 devstack sudo[91586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:46 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] Volume volume-61d13d43-22d6-4ae1-b9bc-17c7b8f06b73 (61d13d43-22d6-4ae1-b9bc-17c7b8f06b73): created successfully Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827180d3-b1db-4b9d-8849-8ea674f8d2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] Flow 'volume_create_manager' (7f42923d-5624-4540-b3dd-e289e28d7b53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:46 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-19e9b494-9326-4bbf-9a67-4fba3fa2a398 tempest-AttachVolumeShelveTestJSON-2071670093 None] Created volume successfully. Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-bf7d98f1-3c8a-4520-91c3-fede7144f4dc req-23a7004f-5412-45d3-8666-063398c91b8a tempest-ServerActionsTestOtherA-1922255062 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb', 'name': 'volume-e4b718bb-36a0-4ac8-a202-77b2127c453a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '67311b94-59cd-404e-b20c-9e33370f0b5d', 'enforce_multipath': True} {{(pid=87128) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:00:46 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-bf7d98f1-3c8a-4520-91c3-fede7144f4dc req-23a7004f-5412-45d3-8666-063398c91b8a tempest-ServerActionsTestOtherA-1922255062 None] attachment_update completed successfully. Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-cf599cf1-3564-4a8f-a448-9862bf9ef969 req-2a8d29ef-5fe2-4b08-b005-d09f7355fd91 tempest-VolumesSnapshotsTestJSON-2127590053 None] Acquiring lock "cinder-316aa381-447b-4aaf-baa1-df2784910111-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-cf599cf1-3564-4a8f-a448-9862bf9ef969 req-2a8d29ef-5fe2-4b08-b005-d09f7355fd91 tempest-VolumesSnapshotsTestJSON-2127590053 None] Lock "cinder-316aa381-447b-4aaf-baa1-df2784910111-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-cf599cf1-3564-4a8f-a448-9862bf9ef969 req-2a8d29ef-5fe2-4b08-b005-d09f7355fd91 tempest-VolumesSnapshotsTestJSON-2127590053 None] Acquiring lock "cinder-quobyte-c7968c2e-72eb-4382-8e54-0420a1f94485" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-cf599cf1-3564-4a8f-a448-9862bf9ef969 req-2a8d29ef-5fe2-4b08-b005-d09f7355fd91 tempest-VolumesSnapshotsTestJSON-2127590053 None] Lock "cinder-quobyte-c7968c2e-72eb-4382-8e54-0420a1f94485" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-cf599cf1-3564-4a8f-a448-9862bf9ef969 req-2a8d29ef-5fe2-4b08-b005-d09f7355fd91 tempest-VolumesSnapshotsTestJSON-2127590053 None] Acquiring lock "cinder-quobyte-316aa381-447b-4aaf-baa1-df2784910111" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-cf599cf1-3564-4a8f-a448-9862bf9ef969 req-2a8d29ef-5fe2-4b08-b005-d09f7355fd91 tempest-VolumesSnapshotsTestJSON-2127590053 None] Lock "cinder-quobyte-316aa381-447b-4aaf-baa1-df2784910111" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [req-cf599cf1-3564-4a8f-a448-9862bf9ef969 req-2a8d29ef-5fe2-4b08-b005-d09f7355fd91 tempest-VolumesSnapshotsTestJSON-2127590053 None] Deleting offline snapshot 316aa381-447b-4aaf-baa1-df2784910111 of volume c7968c2e-72eb-4382-8e54-0420a1f94485 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [req-cf599cf1-3564-4a8f-a448-9862bf9ef969 req-2a8d29ef-5fe2-4b08-b005-d09f7355fd91 tempest-VolumesSnapshotsTestJSON-2127590053 None] snapshot_file for this snap is: volume-c7968c2e-72eb-4382-8e54-0420a1f94485.316aa381-447b-4aaf-baa1-df2784910111 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bf67e3-5635-4af3-b925-93f5682e2416]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-cf599cf1-3564-4a8f-a448-9862bf9ef969 req-2a8d29ef-5fe2-4b08-b005-d09f7355fd91 tempest-VolumesSnapshotsTestJSON-2127590053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485.316aa381-447b-4aaf-baa1-df2784910111 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:46 devstack sudo[91595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485.316aa381-447b-4aaf-baa1-df2784910111 Sep 01 02:00:46 devstack sudo[91595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:46 devstack sudo[91586]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20 1073741824" returned: 0 in 0.808s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:46 devstack sudo[91642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20 Sep 01 02:00:46 devstack sudo[91642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:47 devstack sudo[91595]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-cf599cf1-3564-4a8f-a448-9862bf9ef969 req-2a8d29ef-5fe2-4b08-b005-d09f7355fd91 tempest-VolumesSnapshotsTestJSON-2127590053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485.316aa381-447b-4aaf-baa1-df2784910111" returned: 0 in 0.501s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:47 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [req-cf599cf1-3564-4a8f-a448-9862bf9ef969 req-2a8d29ef-5fe2-4b08-b005-d09f7355fd91 tempest-VolumesSnapshotsTestJSON-2127590053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7968c2e-72eb-4382-8e54-0420a1f94485(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:00:47 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a06dd9-7f04-47d8-8fef-99b485b08060]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-cf599cf1-3564-4a8f-a448-9862bf9ef969 req-2a8d29ef-5fe2-4b08-b005-d09f7355fd91 tempest-VolumesSnapshotsTestJSON-2127590053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:47 devstack sudo[91642]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20" returned: 0 in 0.488s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:47 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:00:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:47 devstack sudo[91681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485 Sep 01 02:00:47 devstack sudo[91681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b10f03-0c4d-4b65-bb85-1fa6f15de87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a222a766-c2e4-4561-8c0f-caa120341b20', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97245e5c-c49e-4a37-b060-3ee3f5a875c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:47 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] Volume volume-a222a766-c2e4-4561-8c0f-caa120341b20 (a222a766-c2e4-4561-8c0f-caa120341b20): created successfully Sep 01 02:00:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97245e5c-c49e-4a37-b060-3ee3f5a875c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] Flow 'volume_create_manager' (c545a92b-f8c4-4838-b478-2f84f26b7f14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:47 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-900606b4-cc38-4336-b61b-3fabb3e5dcd0 tempest-GroupSnapshotsTest-772471291 None] Created volume successfully. Sep 01 02:00:47 devstack sudo[91681]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-cf599cf1-3564-4a8f-a448-9862bf9ef969 req-2a8d29ef-5fe2-4b08-b005-d09f7355fd91 tempest-VolumesSnapshotsTestJSON-2127590053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485" returned: 0 in 0.648s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-cf599cf1-3564-4a8f-a448-9862bf9ef969 req-2a8d29ef-5fe2-4b08-b005-d09f7355fd91 tempest-VolumesSnapshotsTestJSON-2127590053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485.316aa381-447b-4aaf-baa1-df2784910111 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:47 devstack sudo[92028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485.316aa381-447b-4aaf-baa1-df2784910111 Sep 01 02:00:47 devstack sudo[92028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:48 devstack sudo[92028]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-cf599cf1-3564-4a8f-a448-9862bf9ef969 req-2a8d29ef-5fe2-4b08-b005-d09f7355fd91 tempest-VolumesSnapshotsTestJSON-2127590053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485.316aa381-447b-4aaf-baa1-df2784910111" returned: 0 in 0.596s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-cf599cf1-3564-4a8f-a448-9862bf9ef969 req-2a8d29ef-5fe2-4b08-b005-d09f7355fd91 tempest-VolumesSnapshotsTestJSON-2127590053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485.316aa381-447b-4aaf-baa1-df2784910111 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:48 devstack sudo[92040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485.316aa381-447b-4aaf-baa1-df2784910111 Sep 01 02:00:48 devstack sudo[92040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:48 devstack sudo[92040]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-cf599cf1-3564-4a8f-a448-9862bf9ef969 req-2a8d29ef-5fe2-4b08-b005-d09f7355fd91 tempest-VolumesSnapshotsTestJSON-2127590053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485.316aa381-447b-4aaf-baa1-df2784910111" returned: 0 in 0.383s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-cf599cf1-3564-4a8f-a448-9862bf9ef969 req-2a8d29ef-5fe2-4b08-b005-d09f7355fd91 tempest-VolumesSnapshotsTestJSON-2127590053 None] Lock "cinder-quobyte-316aa381-447b-4aaf-baa1-df2784910111" released by "_delete_snapshot" :: held 2.367s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-cf599cf1-3564-4a8f-a448-9862bf9ef969 req-2a8d29ef-5fe2-4b08-b005-d09f7355fd91 tempest-VolumesSnapshotsTestJSON-2127590053 None] Lock "cinder-quobyte-c7968c2e-72eb-4382-8e54-0420a1f94485" released by "delete_snapshot" :: held 2.411s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:49 devstack cinder-volume[87128]: WARNING cinder.quota [req-cf599cf1-3564-4a8f-a448-9862bf9ef969 req-2a8d29ef-5fe2-4b08-b005-d09f7355fd91 tempest-VolumesSnapshotsTestJSON-2127590053 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:00:49 devstack cinder-volume[87128]: DEBUG cinder.quota [req-cf599cf1-3564-4a8f-a448-9862bf9ef969 req-2a8d29ef-5fe2-4b08-b005-d09f7355fd91 tempest-VolumesSnapshotsTestJSON-2127590053 None] Created reservations ['ea992910-23c1-4a73-abb7-33cc0b3472db', '1e5a0113-df22-4b0f-9bb8-b14228605b91', 'a02f71cd-4d19-42f6-8667-5e3dde33a730', '31c51ecc-4e17-4dd6-ac2a-595358a0bf6b'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:00:49 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-cf599cf1-3564-4a8f-a448-9862bf9ef969 req-2a8d29ef-5fe2-4b08-b005-d09f7355fd91 tempest-VolumesSnapshotsTestJSON-2127590053 None] Delete snapshot completed successfully. Sep 01 02:00:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-cf599cf1-3564-4a8f-a448-9862bf9ef969 req-2a8d29ef-5fe2-4b08-b005-d09f7355fd91 tempest-VolumesSnapshotsTestJSON-2127590053 None] Lock "cinder-316aa381-447b-4aaf-baa1-df2784910111-delete_snapshot" released by "delete_snapshot" :: held 2.805s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:49 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:00:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] Flow 'volume_create_manager' (579956d1-db06-4ebf-85c4-47a44f7ba630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a379e6d-df10-4d10-91ed-e09739a2ffea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a379e6d-df10-4d10-91ed-e09739a2ffea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-38284608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d4e53dc1-8863-4ab2-b8ba-ee2f8f2a763a,host='devstack@QuobyteHD#QuobyteHD',id=db386395-75ed-4e88-9ab4-b7e7c2ffa1ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b0b9e0db9e84d03afbb82b02b63d321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:50Z,use_quota=True,user_id='eaa1d30d16124f3a984e586c2dab8bb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f2a00af-74a9-4817-a64a-47fe6729ea65),volume_type_id=0f2a00af-74a9-4817-a64a-47fe6729ea65)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76eabab0-4def-4626-bc12-0acda14f3c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76eabab0-4def-4626-bc12-0acda14f3c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c99a6ec-7225-41b8-8bd9-044480348450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c99a6ec-7225-41b8-8bd9-044480348450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db386395-75ed-4e88-9ab4-b7e7c2ffa1ca', 'volume_name': 'volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f8045d4-916d-4f5f-838b-a0b73d2c8f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f8045d4-916d-4f5f-838b-a0b73d2c8f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94524149-0945-4334-af8d-3503d32822c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:49 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] Volume db386395-75ed-4e88-9ab4-b7e7c2ffa1ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca', 'volume_size': 1} Sep 01 02:00:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d4e53dc1-8863-4ab2-b8ba-ee2f8f2a763a,created_at=2026-09-01T00:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-38284608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d4e53dc1-8863-4ab2-b8ba-ee2f8f2a763a,host='devstack@QuobyteHD#QuobyteHD',id=db386395-75ed-4e88-9ab4-b7e7c2ffa1ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b0b9e0db9e84d03afbb82b02b63d321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:50Z,use_quota=True,user_id='eaa1d30d16124f3a984e586c2dab8bb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f2a00af-74a9-4817-a64a-47fe6729ea65),volume_type_id=0f2a00af-74a9-4817-a64a-47fe6729ea65)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:00:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] Creating volume db386395-75ed-4e88-9ab4-b7e7c2ffa1ca {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:00:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:00:49 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:00:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:49 devstack sudo[92057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca 1073741824 Sep 01 02:00:49 devstack sudo[92057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-224d0552-dc18-4d73-b004-0e42f5cbf256 req-8d9e934d-c322-4714-b2f2-76b6e4764f11 tempest-VolumesSnapshotsTestJSON-2127590053 None] Acquiring lock "cinder-c7968c2e-72eb-4382-8e54-0420a1f94485-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-224d0552-dc18-4d73-b004-0e42f5cbf256 req-8d9e934d-c322-4714-b2f2-76b6e4764f11 tempest-VolumesSnapshotsTestJSON-2127590053 None] Lock "cinder-c7968c2e-72eb-4382-8e54-0420a1f94485-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-224d0552-dc18-4d73-b004-0e42f5cbf256 req-8d9e934d-c322-4714-b2f2-76b6e4764f11 tempest-VolumesSnapshotsTestJSON-2127590053 None] Acquiring lock "cinder-quobyte-c7968c2e-72eb-4382-8e54-0420a1f94485" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:50 devstack sudo[92057]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-224d0552-dc18-4d73-b004-0e42f5cbf256 req-8d9e934d-c322-4714-b2f2-76b6e4764f11 tempest-VolumesSnapshotsTestJSON-2127590053 None] Lock "cinder-quobyte-c7968c2e-72eb-4382-8e54-0420a1f94485" acquired by "delete_volume" :: waited 0.035s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca 1073741824" returned: 0 in 0.688s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:50 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca715f4e-914b-4b9e-94f9-ab6918f6d7b4]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-224d0552-dc18-4d73-b004-0e42f5cbf256 req-8d9e934d-c322-4714-b2f2-76b6e4764f11 tempest-VolumesSnapshotsTestJSON-2127590053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:50 devstack sudo[92065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca Sep 01 02:00:50 devstack sudo[92065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:50 devstack sudo[92064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485 Sep 01 02:00:50 devstack sudo[92064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:51 devstack sudo[92065]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca" returned: 0 in 0.552s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:51 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:00:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:51 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94524149-0945-4334-af8d-3503d32822c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:51 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ebcee4-c5f4-491e-91c5-c38833316a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:51 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] Volume volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca (db386395-75ed-4e88-9ab4-b7e7c2ffa1ca): created successfully Sep 01 02:00:51 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ebcee4-c5f4-491e-91c5-c38833316a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:51 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] Flow 'volume_create_manager' (579956d1-db06-4ebf-85c4-47a44f7ba630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:51 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-8459b0e4-18df-4285-a179-f9fc7bea2e67 tempest-GroupSnapshotsTest-772471291 None] Created volume successfully. Sep 01 02:00:51 devstack sudo[92064]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-224d0552-dc18-4d73-b004-0e42f5cbf256 req-8d9e934d-c322-4714-b2f2-76b6e4764f11 tempest-VolumesSnapshotsTestJSON-2127590053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485" returned: 0 in 0.960s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-224d0552-dc18-4d73-b004-0e42f5cbf256 req-8d9e934d-c322-4714-b2f2-76b6e4764f11 tempest-VolumesSnapshotsTestJSON-2127590053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:51 devstack sudo[92073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485 Sep 01 02:00:51 devstack sudo[92073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:52 devstack sudo[92073]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-224d0552-dc18-4d73-b004-0e42f5cbf256 req-8d9e934d-c322-4714-b2f2-76b6e4764f11 tempest-VolumesSnapshotsTestJSON-2127590053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7968c2e-72eb-4382-8e54-0420a1f94485" returned: 0 in 0.603s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-224d0552-dc18-4d73-b004-0e42f5cbf256 req-8d9e934d-c322-4714-b2f2-76b6e4764f11 tempest-VolumesSnapshotsTestJSON-2127590053 None] Lock "cinder-quobyte-c7968c2e-72eb-4382-8e54-0420a1f94485" released by "delete_volume" :: held 1.674s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:52 devstack cinder-volume[87128]: DEBUG cinder.quota [req-224d0552-dc18-4d73-b004-0e42f5cbf256 req-8d9e934d-c322-4714-b2f2-76b6e4764f11 tempest-VolumesSnapshotsTestJSON-2127590053 None] Created reservations ['13ccf3e9-5a72-432f-a207-c6ebefe351bc', 'dcff120e-f83d-4fec-9739-7e7f963bbebb', 'cb8c4e9e-e49f-4e6c-a36b-a9c8fdfd36b6', '48bda955-5aa8-4ae4-b41d-c82775df7d99'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:00:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-224d0552-dc18-4d73-b004-0e42f5cbf256 req-8d9e934d-c322-4714-b2f2-76b6e4764f11 tempest-VolumesSnapshotsTestJSON-2127590053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-224d0552-dc18-4d73-b004-0e42f5cbf256 req-8d9e934d-c322-4714-b2f2-76b6e4764f11 tempest-VolumesSnapshotsTestJSON-2127590053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:52 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [req-224d0552-dc18-4d73-b004-0e42f5cbf256 req-8d9e934d-c322-4714-b2f2-76b6e4764f11 tempest-VolumesSnapshotsTestJSON-2127590053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:52 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [req-224d0552-dc18-4d73-b004-0e42f5cbf256 req-8d9e934d-c322-4714-b2f2-76b6e4764f11 tempest-VolumesSnapshotsTestJSON-2127590053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-224d0552-dc18-4d73-b004-0e42f5cbf256 req-8d9e934d-c322-4714-b2f2-76b6e4764f11 tempest-VolumesSnapshotsTestJSON-2127590053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-224d0552-dc18-4d73-b004-0e42f5cbf256 req-8d9e934d-c322-4714-b2f2-76b6e4764f11 tempest-VolumesSnapshotsTestJSON-2127590053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:52 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-1c477c52-17c9-486a-a60a-583b0c42cb31 tempest-GroupSnapshotsTest-772471291 None] Update group completed successfully. Sep 01 02:00:52 devstack sudo[92077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:00:52 devstack sudo[92077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:53 devstack sudo[92077]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-224d0552-dc18-4d73-b004-0e42f5cbf256 req-8d9e934d-c322-4714-b2f2-76b6e4764f11 tempest-VolumesSnapshotsTestJSON-2127590053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.650s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:53 devstack cinder-volume[87128]: DEBUG cinder.manager [req-224d0552-dc18-4d73-b004-0e42f5cbf256 req-8d9e934d-c322-4714-b2f2-76b6e4764f11 tempest-VolumesSnapshotsTestJSON-2127590053 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:00:53 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-224d0552-dc18-4d73-b004-0e42f5cbf256 req-8d9e934d-c322-4714-b2f2-76b6e4764f11 tempest-VolumesSnapshotsTestJSON-2127590053 None] Deleted volume successfully. Sep 01 02:00:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-224d0552-dc18-4d73-b004-0e42f5cbf256 req-8d9e934d-c322-4714-b2f2-76b6e4764f11 tempest-VolumesSnapshotsTestJSON-2127590053 None] Lock "cinder-c7968c2e-72eb-4382-8e54-0420a1f94485-delete_volume" released by "delete_volume" :: held 2.962s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:54 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-224ba42c-b62d-406e-93fa-0159fbf97867 tempest-GroupSnapshotsTest-772471291 None] Update group completed successfully. Sep 01 02:00:55 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-94066695-3ab7-4628-a5b7-75836e3b5dce tempest-GroupSnapshotsTest-772471291 None] Update group completed successfully. Sep 01 02:00:56 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-533eefab-578e-4539-97d4-dd156b023d21 tempest-GroupSnapshotsTest-772471291 None] Update group completed successfully. Sep 01 02:00:58 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] GroupSnapshot 941d0834-b02c-4ad8-b6f4-45f8ac983b86: creating. Sep 01 02:00:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] Group snapshot 941d0834-b02c-4ad8-b6f4-45f8ac983b86: creating. {{(pid=87128) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 02:00:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] Creating offline snapshot caa8d253-e24f-403f-9dd7-04ee78f2cebb of volume db386395-75ed-4e88-9ab4-b7e7c2ffa1ca {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:00:58 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[9275e680-aaed-4ff2-904b-ad12554d0f64]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:58 devstack sudo[92090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca Sep 01 02:00:58 devstack sudo[92090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:59 devstack sudo[92090]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca" returned: 0 in 0.910s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca.caa8d253-e24f-403f-9dd7-04ee78f2cebb 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:59 devstack sudo[92097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca.caa8d253-e24f-403f-9dd7-04ee78f2cebb 1G Sep 01 02:00:59 devstack sudo[92097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:00 devstack sudo[92097]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca.caa8d253-e24f-403f-9dd7-04ee78f2cebb 1G" returned: 0 in 1.245s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca.caa8d253-e24f-403f-9dd7-04ee78f2cebb {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:01 devstack sudo[92120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca.caa8d253-e24f-403f-9dd7-04ee78f2cebb Sep 01 02:01:01 devstack sudo[92120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:01 devstack sudo[92120]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca.caa8d253-e24f-403f-9dd7-04ee78f2cebb" returned: 0 in 0.626s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:01 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca.caa8d253-e24f-403f-9dd7-04ee78f2cebb is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:01:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca.caa8d253-e24f-403f-9dd7-04ee78f2cebb {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:01 devstack sudo[92126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca.caa8d253-e24f-403f-9dd7-04ee78f2cebb Sep 01 02:01:01 devstack sudo[92126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:02 devstack sudo[92126]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca.caa8d253-e24f-403f-9dd7-04ee78f2cebb" returned: 0 in 0.561s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:02 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:01:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] Flow 'volume_create_manager' (8c0780b0-2992-48de-ae60-d4586045dd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb39e1a3-ff15-4aad-afed-16694daf7364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:02 devstack sudo[92129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca.info Sep 01 02:01:02 devstack sudo[92129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb39e1a3-ff15-4aad-afed-16694daf7364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-387202514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=689632c3-e03b-4c2a-8460-01d46f95199e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='060acef157434a0cb0e59f27cb4ae180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:01:02Z,use_quota=True,user_id='8aedfe208a6744fc831565f054d4f801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d42c31c0-9426-48d4-9edc-d93b9d367e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d42c31c0-9426-48d4-9edc-d93b9d367e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acf90a75-e4c6-4f90-8e59-fbadcb47f101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acf90a75-e4c6-4f90-8e59-fbadcb47f101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '689632c3-e03b-4c2a-8460-01d46f95199e', 'volume_name': 'volume-689632c3-e03b-4c2a-8460-01d46f95199e', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1680fca1-7f50-488b-9aa0-7fa54cd8d373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1680fca1-7f50-488b-9aa0-7fa54cd8d373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a97f25-1393-4fe1-b181-16f4b2f9efc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:02 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] Volume 689632c3-e03b-4c2a-8460-01d46f95199e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-689632c3-e03b-4c2a-8460-01d46f95199e', 'volume_size': 1} Sep 01 02:01:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:02 devstack sudo[92129]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca.info" returned: 0 in 0.591s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:02 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:01:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:02 devstack sudo[92132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca.info Sep 01 02:01:02 devstack sudo[92132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-1c07f52b-a0a8-4c76-b701-1ab0be8742ae req-cf5f97ee-e9cc-4175-b7d2-9bcd36957ffb tempest-AttachVolumeShelveTestJSON-2071670093 None] No connector for attachment 6b698e43-01c9-496e-a271-420c219102aa; skipping storage backend terminate_connection call. {{(pid=87128) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 01 02:01:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-1c07f52b-a0a8-4c76-b701-1ab0be8742ae req-cf5f97ee-e9cc-4175-b7d2-9bcd36957ffb tempest-AttachVolumeShelveTestJSON-2071670093 None] Deleting attachment 6b698e43-01c9-496e-a271-420c219102aa. {{(pid=87128) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:01:03 devstack sudo[92132]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca.info" returned: 0 in 0.336s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.512s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:03 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] Creating offline snapshot cfdcb807-c39f-4c5f-8b10-6bde2ab0991c of volume a222a766-c2e4-4561-8c0f-caa120341b20 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:01:03 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27c14a3-de14-4a5a-9578-736aeb85fd9a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:03 devstack sudo[92143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20 Sep 01 02:01:03 devstack sudo[92143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:03 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-d878d096-59cd-46c0-aa47-3dd3a0ef0a5e req-ab309956-72f9-45f7-9b24-96e23cbcd7dd tempest-ServerActionsTestOtherA-1922255062 None] Terminate volume connection completed successfully. Sep 01 02:01:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-d878d096-59cd-46c0-aa47-3dd3a0ef0a5e req-ab309956-72f9-45f7-9b24-96e23cbcd7dd tempest-ServerActionsTestOtherA-1922255062 None] Deleting attachment 67311b94-59cd-404e-b20c-9e33370f0b5d. {{(pid=87128) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:01:04 devstack sudo[92143]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20" returned: 0 in 0.652s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20.cfdcb807-c39f-4c5f-8b10-6bde2ab0991c 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:04 devstack sudo[92187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20.cfdcb807-c39f-4c5f-8b10-6bde2ab0991c 1G Sep 01 02:01:04 devstack sudo[92187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:04 devstack sudo[92187]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20.cfdcb807-c39f-4c5f-8b10-6bde2ab0991c 1G" returned: 0 in 0.816s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a222a766-c2e4-4561-8c0f-caa120341b20 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20.cfdcb807-c39f-4c5f-8b10-6bde2ab0991c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:04 devstack sudo[92194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a222a766-c2e4-4561-8c0f-caa120341b20 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20.cfdcb807-c39f-4c5f-8b10-6bde2ab0991c Sep 01 02:01:04 devstack sudo[92194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:05 devstack sudo[92194]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a222a766-c2e4-4561-8c0f-caa120341b20 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20.cfdcb807-c39f-4c5f-8b10-6bde2ab0991c" returned: 0 in 0.405s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:05 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20.cfdcb807-c39f-4c5f-8b10-6bde2ab0991c is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:01:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20.cfdcb807-c39f-4c5f-8b10-6bde2ab0991c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:05 devstack sudo[92201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20.cfdcb807-c39f-4c5f-8b10-6bde2ab0991c Sep 01 02:01:05 devstack sudo[92201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:05 devstack sudo[92201]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20.cfdcb807-c39f-4c5f-8b10-6bde2ab0991c" returned: 0 in 0.301s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:05 devstack sudo[92204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20.info Sep 01 02:01:05 devstack sudo[92204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:05 devstack sudo[92204]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20.info" returned: 0 in 0.394s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:05 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:01:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:06 devstack sudo[92215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20.info Sep 01 02:01:06 devstack sudo[92215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:06 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=101,cinder:UPDATE=85,cinder:DELETE=4,cinder:INSERT=21 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:01:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-d878d096-59cd-46c0-aa47-3dd3a0ef0a5e req-87d13b4c-e7ac-4a82-8ea4-bd6da7536918 tempest-ServerActionsTestOtherA-1922255062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:06 devstack sudo[92215]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20.info" returned: 0 in 0.397s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.139s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.904s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:06 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-387202514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=689632c3-e03b-4c2a-8460-01d46f95199e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='060acef157434a0cb0e59f27cb4ae180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:01:02Z,use_quota=True,user_id='8aedfe208a6744fc831565f054d4f801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:01:06 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] Creating volume 689632c3-e03b-4c2a-8460-01d46f95199e {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:01:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:06 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:06 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:06 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:01:06 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:01:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-689632c3-e03b-4c2a-8460-01d46f95199e 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:06 devstack sudo[92219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-689632c3-e03b-4c2a-8460-01d46f95199e 1073741824 Sep 01 02:01:06 devstack sudo[92219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:06 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-7b2da0d9-15b4-4206-bd44-a3d9a94ee794 tempest-GroupSnapshotsTest-772471291 None] group_snapshot 941d0834-b02c-4ad8-b6f4-45f8ac983b86: created successfully Sep 01 02:01:06 devstack sudo[92219]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-689632c3-e03b-4c2a-8460-01d46f95199e 1073741824" returned: 0 in 0.494s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-689632c3-e03b-4c2a-8460-01d46f95199e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:06 devstack sudo[92225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-689632c3-e03b-4c2a-8460-01d46f95199e Sep 01 02:01:06 devstack sudo[92225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:07 devstack sudo[92225]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-689632c3-e03b-4c2a-8460-01d46f95199e" returned: 0 in 0.285s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:07 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:01:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-d878d096-59cd-46c0-aa47-3dd3a0ef0a5e req-87d13b4c-e7ac-4a82-8ea4-bd6da7536918 tempest-ServerActionsTestOtherA-1922255062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.993s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a97f25-1393-4fe1-b181-16f4b2f9efc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-689632c3-e03b-4c2a-8460-01d46f95199e', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (525a6d55-97b6-44ec-878b-ca3d00036417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-d878d096-59cd-46c0-aa47-3dd3a0ef0a5e req-87d13b4c-e7ac-4a82-8ea4-bd6da7536918 tempest-ServerActionsTestOtherA-1922255062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:07 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] Volume volume-689632c3-e03b-4c2a-8460-01d46f95199e (689632c3-e03b-4c2a-8460-01d46f95199e): created successfully Sep 01 02:01:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (525a6d55-97b6-44ec-878b-ca3d00036417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] Flow 'volume_create_manager' (8c0780b0-2992-48de-ae60-d4586045dd94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:07 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-16c95bfd-b8fb-430a-a377-6a7ad4af9db9 tempest-VolumesTestJSON-1753717260 None] Created volume successfully. Sep 01 02:01:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-d878d096-59cd-46c0-aa47-3dd3a0ef0a5e req-87d13b4c-e7ac-4a82-8ea4-bd6da7536918 tempest-ServerActionsTestOtherA-1922255062 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb', 'name': 'volume-e4b718bb-36a0-4ac8-a202-77b2127c453a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '38720ed9-ad56-4773-a347-91f66b966355', 'enforce_multipath': True} {{(pid=87128) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:01:07 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-d878d096-59cd-46c0-aa47-3dd3a0ef0a5e req-87d13b4c-e7ac-4a82-8ea4-bd6da7536918 tempest-ServerActionsTestOtherA-1922255062 None] attachment_update completed successfully. Sep 01 02:01:07 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] group_snapshot 941d0834-b02c-4ad8-b6f4-45f8ac983b86: deleting Sep 01 02:01:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] group_snapshot 941d0834-b02c-4ad8-b6f4-45f8ac983b86: deleting {{(pid=87128) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 02:01:07 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "cinder-quobyte-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:07 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] Lock "cinder-quobyte-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:07 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "cinder-quobyte-caa8d253-e24f-403f-9dd7-04ee78f2cebb" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:07 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] Lock "cinder-quobyte-caa8d253-e24f-403f-9dd7-04ee78f2cebb" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:07 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] Deleting offline snapshot caa8d253-e24f-403f-9dd7-04ee78f2cebb of volume db386395-75ed-4e88-9ab4-b7e7c2ffa1ca {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:01:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] snapshot_file for this snap is: volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca.caa8d253-e24f-403f-9dd7-04ee78f2cebb {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:01:08 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf748b0-7791-41dd-a95d-569367c20014]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca.caa8d253-e24f-403f-9dd7-04ee78f2cebb {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:08 devstack sudo[92294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca.caa8d253-e24f-403f-9dd7-04ee78f2cebb Sep 01 02:01:08 devstack sudo[92294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:08 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:01:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] Flow 'volume_create_manager' (883f458a-459b-425b-ae27-bf830bc9cc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81a27544-a137-4d9c-8c21-030bb9bf45e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81a27544-a137-4d9c-8c21-030bb9bf45e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-322358567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78b087e8-735a-4dfc-9eb6-c101c483e764,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='060acef157434a0cb0e59f27cb4ae180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:01:08Z,use_quota=True,user_id='8aedfe208a6744fc831565f054d4f801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d3ebcf6-26e8-4774-a3c9-e7901c5ab54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d3ebcf6-26e8-4774-a3c9-e7901c5ab54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d47b733-a806-451b-8329-3b6e0e74a247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d47b733-a806-451b-8329-3b6e0e74a247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78b087e8-735a-4dfc-9eb6-c101c483e764', 'volume_name': 'volume-78b087e8-735a-4dfc-9eb6-c101c483e764', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab02194-83cb-449c-8a0c-a2230b997ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab02194-83cb-449c-8a0c-a2230b997ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12560fa-b575-4565-95fa-7cd337d538bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:08 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] Volume 78b087e8-735a-4dfc-9eb6-c101c483e764: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78b087e8-735a-4dfc-9eb6-c101c483e764', 'volume_size': 1} Sep 01 02:01:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-322358567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78b087e8-735a-4dfc-9eb6-c101c483e764,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='060acef157434a0cb0e59f27cb4ae180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:01:08Z,use_quota=True,user_id='8aedfe208a6744fc831565f054d4f801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:01:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] Creating volume 78b087e8-735a-4dfc-9eb6-c101c483e764 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:01:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:01:08 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:01:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78b087e8-735a-4dfc-9eb6-c101c483e764 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:08 devstack sudo[92449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78b087e8-735a-4dfc-9eb6-c101c483e764 1073741824 Sep 01 02:01:08 devstack sudo[92449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:08 devstack sudo[92294]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca.caa8d253-e24f-403f-9dd7-04ee78f2cebb" returned: 0 in 0.875s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:01:08 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68edfdd-5388-44c2-99fa-87689ececacd]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:09 devstack sudo[92644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca Sep 01 02:01:09 devstack sudo[92644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:09 devstack sudo[92644]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca" returned: 0 in 0.569s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca.caa8d253-e24f-403f-9dd7-04ee78f2cebb {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:09 devstack sudo[92664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca.caa8d253-e24f-403f-9dd7-04ee78f2cebb Sep 01 02:01:09 devstack sudo[92664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:09 devstack sudo[92449]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78b087e8-735a-4dfc-9eb6-c101c483e764 1073741824" returned: 0 in 0.883s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78b087e8-735a-4dfc-9eb6-c101c483e764 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:09 devstack sudo[92666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78b087e8-735a-4dfc-9eb6-c101c483e764 Sep 01 02:01:09 devstack sudo[92666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:10 devstack sudo[92666]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78b087e8-735a-4dfc-9eb6-c101c483e764" returned: 0 in 0.517s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:10 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:01:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:10 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12560fa-b575-4565-95fa-7cd337d538bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78b087e8-735a-4dfc-9eb6-c101c483e764', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:10 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6471d4fe-3931-4189-a69a-0e8e63577566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:10 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] Volume volume-78b087e8-735a-4dfc-9eb6-c101c483e764 (78b087e8-735a-4dfc-9eb6-c101c483e764): created successfully Sep 01 02:01:10 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6471d4fe-3931-4189-a69a-0e8e63577566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:10 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] Flow 'volume_create_manager' (883f458a-459b-425b-ae27-bf830bc9cc8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:10 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-863734b3-e041-45d1-b298-a59d449682cf tempest-VolumesTestJSON-1753717260 None] Created volume successfully. Sep 01 02:01:10 devstack sudo[92664]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca.caa8d253-e24f-403f-9dd7-04ee78f2cebb" returned: 0 in 0.950s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca.caa8d253-e24f-403f-9dd7-04ee78f2cebb {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:10 devstack sudo[92674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca.caa8d253-e24f-403f-9dd7-04ee78f2cebb Sep 01 02:01:10 devstack sudo[92674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:11 devstack sudo[92674]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca.caa8d253-e24f-403f-9dd7-04ee78f2cebb" returned: 0 in 0.577s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] Lock "cinder-quobyte-caa8d253-e24f-403f-9dd7-04ee78f2cebb" released by "_delete_snapshot" :: held 3.196s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] Lock "cinder-quobyte-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca" released by "delete_snapshot" :: held 3.242s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "cinder-quobyte-a222a766-c2e4-4561-8c0f-caa120341b20" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] Lock "cinder-quobyte-a222a766-c2e4-4561-8c0f-caa120341b20" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "cinder-quobyte-cfdcb807-c39f-4c5f-8b10-6bde2ab0991c" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] Lock "cinder-quobyte-cfdcb807-c39f-4c5f-8b10-6bde2ab0991c" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:11 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] Deleting offline snapshot cfdcb807-c39f-4c5f-8b10-6bde2ab0991c of volume a222a766-c2e4-4561-8c0f-caa120341b20 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:01:11 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] snapshot_file for this snap is: volume-a222a766-c2e4-4561-8c0f-caa120341b20.cfdcb807-c39f-4c5f-8b10-6bde2ab0991c {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:01:11 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cce5431-623f-4264-86b8-4611feaa148a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20.cfdcb807-c39f-4c5f-8b10-6bde2ab0991c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:11 devstack sudo[92679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20.cfdcb807-c39f-4c5f-8b10-6bde2ab0991c Sep 01 02:01:11 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:12 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:01:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] Flow 'volume_create_manager' (490ff0c8-c814-471e-98af-fb50ec04331d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90133cc6-6505-4fa4-82d4-0888e2779719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90133cc6-6505-4fa4-82d4-0888e2779719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1299761024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3fdb992-ca77-4900-ae36-f93352d9a605,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='060acef157434a0cb0e59f27cb4ae180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:01:12Z,use_quota=True,user_id='8aedfe208a6744fc831565f054d4f801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f0a575-3a0e-4b44-b8ed-48d2fa1c1c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f0a575-3a0e-4b44-b8ed-48d2fa1c1c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:12 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e8646f-f28d-4ff8-a87f-43882552a343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e8646f-f28d-4ff8-a87f-43882552a343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3fdb992-ca77-4900-ae36-f93352d9a605', 'volume_name': 'volume-f3fdb992-ca77-4900-ae36-f93352d9a605', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ac9c4e-0cc5-4745-b2c3-54fab8f43043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ac9c4e-0cc5-4745-b2c3-54fab8f43043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3606f92-b694-44f9-a849-5e135bf0aad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:12 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] Volume f3fdb992-ca77-4900-ae36-f93352d9a605: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3fdb992-ca77-4900-ae36-f93352d9a605', 'volume_size': 1} Sep 01 02:01:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:12 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1299761024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3fdb992-ca77-4900-ae36-f93352d9a605,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='060acef157434a0cb0e59f27cb4ae180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:01:12Z,use_quota=True,user_id='8aedfe208a6744fc831565f054d4f801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:01:12 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] Creating volume f3fdb992-ca77-4900-ae36-f93352d9a605 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:01:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:12 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:12 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:12 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:01:12 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:01:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f3fdb992-ca77-4900-ae36-f93352d9a605 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20.cfdcb807-c39f-4c5f-8b10-6bde2ab0991c" returned: 0 in 1.121s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:12 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a222a766-c2e4-4561-8c0f-caa120341b20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:01:12 devstack sudo[92685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f3fdb992-ca77-4900-ae36-f93352d9a605 1073741824 Sep 01 02:01:12 devstack sudo[92685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:12 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef241b4-3432-4e70-a9d5-a0a5d108da3a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:12 devstack sudo[92687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20 Sep 01 02:01:12 devstack sudo[92687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:13 devstack sudo[92687]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20" returned: 0 in 0.657s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20.cfdcb807-c39f-4c5f-8b10-6bde2ab0991c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:13 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20.cfdcb807-c39f-4c5f-8b10-6bde2ab0991c Sep 01 02:01:13 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:13 devstack sudo[92685]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f3fdb992-ca77-4900-ae36-f93352d9a605 1073741824" returned: 0 in 0.989s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f3fdb992-ca77-4900-ae36-f93352d9a605 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:13 devstack sudo[92707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f3fdb992-ca77-4900-ae36-f93352d9a605 Sep 01 02:01:13 devstack sudo[92707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:14 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20.cfdcb807-c39f-4c5f-8b10-6bde2ab0991c" returned: 0 in 0.775s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20.cfdcb807-c39f-4c5f-8b10-6bde2ab0991c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:14 devstack sudo[92707]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f3fdb992-ca77-4900-ae36-f93352d9a605" returned: 0 in 0.472s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:01:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:14 devstack sudo[92719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20.cfdcb807-c39f-4c5f-8b10-6bde2ab0991c Sep 01 02:01:14 devstack sudo[92719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3606f92-b694-44f9-a849-5e135bf0aad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3fdb992-ca77-4900-ae36-f93352d9a605', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0f4b08a-35d1-4d98-919d-a072e3dc6188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:14 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=118,cinder:UPDATE=92,cinder:INSERT=31,cinder:DELETE=6 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:01:14 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] Volume volume-f3fdb992-ca77-4900-ae36-f93352d9a605 (f3fdb992-ca77-4900-ae36-f93352d9a605): created successfully Sep 01 02:01:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0f4b08a-35d1-4d98-919d-a072e3dc6188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] Flow 'volume_create_manager' (490ff0c8-c814-471e-98af-fb50ec04331d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:14 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-cb750b1e-c1f9-4a44-be86-be74a4842c7a tempest-VolumesTestJSON-1753717260 None] Created volume successfully. Sep 01 02:01:14 devstack sudo[92719]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20.cfdcb807-c39f-4c5f-8b10-6bde2ab0991c" returned: 0 in 0.849s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:14 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] Lock "cinder-quobyte-cfdcb807-c39f-4c5f-8b10-6bde2ab0991c" released by "_delete_snapshot" :: held 3.640s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:14 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] Lock "cinder-quobyte-a222a766-c2e4-4561-8c0f-caa120341b20" released by "delete_snapshot" :: held 3.710s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:15 devstack cinder-volume[87128]: WARNING cinder.quota [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1429648582 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1429648582, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:01:15 devstack cinder-volume[87128]: WARNING cinder.quota [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1429648582 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1429648582, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:01:15 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] Created reservations ['4883c36f-55e6-4839-9158-237be48e3b29', 'd9693abb-48a8-4981-a91f-0dfa282b7211', '09612345-f291-4807-a3f4-470f233094ed', 'e8dab5ff-8034-49ab-8908-634205904fb6'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:01:15 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] Created reservations ['1b0832f1-509d-4e65-bb92-21c0db220d86', '23d1aa46-36b3-4818-ae6f-048d749db8eb', '926d434d-d38d-477b-9406-5d8d018f9960', '647bc695-27d7-4f56-bacc-6be34014fc18'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:01:15 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-f7ecbf78-48f5-4100-8780-1281cbd5d38e tempest-GroupSnapshotsTest-772471291 None] group_snapshot 941d0834-b02c-4ad8-b6f4-45f8ac983b86: deleted successfully Sep 01 02:01:16 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2eab2148-9342-427b-b8d7-8abcf55df64a tempest-VolumesTestJSON-1753717260 None] Acquiring lock "cinder-f3fdb992-ca77-4900-ae36-f93352d9a605-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:16 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2eab2148-9342-427b-b8d7-8abcf55df64a tempest-VolumesTestJSON-1753717260 None] Lock "cinder-f3fdb992-ca77-4900-ae36-f93352d9a605-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:16 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2eab2148-9342-427b-b8d7-8abcf55df64a tempest-VolumesTestJSON-1753717260 None] Acquiring lock "cinder-quobyte-f3fdb992-ca77-4900-ae36-f93352d9a605" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:16 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2eab2148-9342-427b-b8d7-8abcf55df64a tempest-VolumesTestJSON-1753717260 None] Lock "cinder-quobyte-f3fdb992-ca77-4900-ae36-f93352d9a605" acquired by "delete_volume" :: waited 0.075s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:16 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5487102-23b7-4b91-a0fe-de849d549624]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2eab2148-9342-427b-b8d7-8abcf55df64a tempest-VolumesTestJSON-1753717260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f3fdb992-ca77-4900-ae36-f93352d9a605 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:16 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:01:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:17 devstack sudo[92777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f3fdb992-ca77-4900-ae36-f93352d9a605 Sep 01 02:01:17 devstack sudo[92777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:17 devstack sudo[92778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:01:17 devstack sudo[92778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:17 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-862c6fa5-d3b6-4df4-a00f-7a97d72dc863 tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "cinder-quobyte-a222a766-c2e4-4561-8c0f-caa120341b20" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:17 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-862c6fa5-d3b6-4df4-a00f-7a97d72dc863 tempest-GroupSnapshotsTest-772471291 None] Lock "cinder-quobyte-a222a766-c2e4-4561-8c0f-caa120341b20" acquired by "delete_volume" :: waited 0.087s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:17 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f00a465-24c6-429d-855c-0d586e93e62a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-862c6fa5-d3b6-4df4-a00f-7a97d72dc863 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:17 devstack sudo[92778]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.677s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:17 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:01:17 devstack sudo[92781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20 Sep 01 02:01:17 devstack sudo[92781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:17 devstack sudo[92777]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2eab2148-9342-427b-b8d7-8abcf55df64a tempest-VolumesTestJSON-1753717260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f3fdb992-ca77-4900-ae36-f93352d9a605" returned: 0 in 0.893s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2eab2148-9342-427b-b8d7-8abcf55df64a tempest-VolumesTestJSON-1753717260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f3fdb992-ca77-4900-ae36-f93352d9a605 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:17 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager._thread_info {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:01:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread count: 28 {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:01:17 devstack sudo[92789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f3fdb992-ca77-4900-ae36-f93352d9a605 Sep 01 02:01:17 devstack sudo[92789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread info: [<_MainThread(MainThread, started 128688016527488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:01:17 devstack sudo[92781]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-862c6fa5-d3b6-4df4-a00f-7a97d72dc863 tempest-GroupSnapshotsTest-772471291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20" returned: 0 in 0.643s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-862c6fa5-d3b6-4df4-a00f-7a97d72dc863 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:18 devstack sudo[92789]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2eab2148-9342-427b-b8d7-8abcf55df64a tempest-VolumesTestJSON-1753717260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f3fdb992-ca77-4900-ae36-f93352d9a605" returned: 0 in 0.374s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:18 devstack sudo[92796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20 Sep 01 02:01:18 devstack sudo[92796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:18 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2eab2148-9342-427b-b8d7-8abcf55df64a tempest-VolumesTestJSON-1753717260 None] Lock "cinder-quobyte-f3fdb992-ca77-4900-ae36-f93352d9a605" released by "delete_volume" :: held 1.355s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:18 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-2eab2148-9342-427b-b8d7-8abcf55df64a tempest-VolumesTestJSON-1753717260 None] Created reservations ['54570db3-d8e1-4d75-a796-e4919750575f', '29efbfaa-e754-40a3-b094-a6f2f19cf40a', '93241c0e-d0c6-4ec7-90cf-77a1f5d84db5', '51f6d63f-9142-48e5-a4d1-26ea0ef03185'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:01:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2eab2148-9342-427b-b8d7-8abcf55df64a tempest-VolumesTestJSON-1753717260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2eab2148-9342-427b-b8d7-8abcf55df64a tempest-VolumesTestJSON-1753717260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2eab2148-9342-427b-b8d7-8abcf55df64a tempest-VolumesTestJSON-1753717260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2eab2148-9342-427b-b8d7-8abcf55df64a tempest-VolumesTestJSON-1753717260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2eab2148-9342-427b-b8d7-8abcf55df64a tempest-VolumesTestJSON-1753717260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2eab2148-9342-427b-b8d7-8abcf55df64a tempest-VolumesTestJSON-1753717260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:18 devstack sudo[92798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:01:18 devstack sudo[92798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:18 devstack sudo[92796]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-862c6fa5-d3b6-4df4-a00f-7a97d72dc863 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a222a766-c2e4-4561-8c0f-caa120341b20" returned: 0 in 0.399s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:18 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-862c6fa5-d3b6-4df4-a00f-7a97d72dc863 tempest-GroupSnapshotsTest-772471291 None] Lock "cinder-quobyte-a222a766-c2e4-4561-8c0f-caa120341b20" released by "delete_volume" :: held 1.232s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:18 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-862c6fa5-d3b6-4df4-a00f-7a97d72dc863 tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "cinder-quobyte-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:18 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-862c6fa5-d3b6-4df4-a00f-7a97d72dc863 tempest-GroupSnapshotsTest-772471291 None] Lock "cinder-quobyte-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca" acquired by "delete_volume" :: waited 0.029s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:18 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e3cfd7-3fc7-45ea-8dcd-91cf8ca58065]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-862c6fa5-d3b6-4df4-a00f-7a97d72dc863 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:18 devstack sudo[92801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca Sep 01 02:01:18 devstack sudo[92801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:18 devstack sudo[92798]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2eab2148-9342-427b-b8d7-8abcf55df64a tempest-VolumesTestJSON-1753717260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.527s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:18 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-2eab2148-9342-427b-b8d7-8abcf55df64a tempest-VolumesTestJSON-1753717260 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:01:18 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-2eab2148-9342-427b-b8d7-8abcf55df64a tempest-VolumesTestJSON-1753717260 None] Deleted volume successfully. Sep 01 02:01:18 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2eab2148-9342-427b-b8d7-8abcf55df64a tempest-VolumesTestJSON-1753717260 None] Lock "cinder-f3fdb992-ca77-4900-ae36-f93352d9a605-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4b0dd1b9-f950-4b67-8164-2559c0a4cac2 tempest-VolumesTestJSON-1753717260 None] Acquiring lock "cinder-78b087e8-735a-4dfc-9eb6-c101c483e764-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4b0dd1b9-f950-4b67-8164-2559c0a4cac2 tempest-VolumesTestJSON-1753717260 None] Lock "cinder-78b087e8-735a-4dfc-9eb6-c101c483e764-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4b0dd1b9-f950-4b67-8164-2559c0a4cac2 tempest-VolumesTestJSON-1753717260 None] Acquiring lock "cinder-quobyte-78b087e8-735a-4dfc-9eb6-c101c483e764" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4b0dd1b9-f950-4b67-8164-2559c0a4cac2 tempest-VolumesTestJSON-1753717260 None] Lock "cinder-quobyte-78b087e8-735a-4dfc-9eb6-c101c483e764" acquired by "delete_volume" :: waited 0.065s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:19 devstack sudo[92801]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-862c6fa5-d3b6-4df4-a00f-7a97d72dc863 tempest-GroupSnapshotsTest-772471291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca" returned: 0 in 0.988s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-862c6fa5-d3b6-4df4-a00f-7a97d72dc863 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:19 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4de362a-6b6d-4595-9344-5296e76bfa2d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4b0dd1b9-f950-4b67-8164-2559c0a4cac2 tempest-VolumesTestJSON-1753717260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78b087e8-735a-4dfc-9eb6-c101c483e764 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:19 devstack sudo[92840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca Sep 01 02:01:19 devstack sudo[92840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:19 devstack sudo[92842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78b087e8-735a-4dfc-9eb6-c101c483e764 Sep 01 02:01:19 devstack sudo[92842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:20 devstack sudo[92840]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-862c6fa5-d3b6-4df4-a00f-7a97d72dc863 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca" returned: 0 in 0.796s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:20 devstack sudo[92842]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4b0dd1b9-f950-4b67-8164-2559c0a4cac2 tempest-VolumesTestJSON-1753717260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78b087e8-735a-4dfc-9eb6-c101c483e764" returned: 0 in 0.790s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4b0dd1b9-f950-4b67-8164-2559c0a4cac2 tempest-VolumesTestJSON-1753717260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78b087e8-735a-4dfc-9eb6-c101c483e764 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:20 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-862c6fa5-d3b6-4df4-a00f-7a97d72dc863 tempest-GroupSnapshotsTest-772471291 None] Lock "cinder-quobyte-db386395-75ed-4e88-9ab4-b7e7c2ffa1ca" released by "delete_volume" :: held 1.919s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:20 devstack sudo[92872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78b087e8-735a-4dfc-9eb6-c101c483e764 Sep 01 02:01:20 devstack sudo[92872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:20 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-862c6fa5-d3b6-4df4-a00f-7a97d72dc863 tempest-GroupSnapshotsTest-772471291 None] Created reservations ['1ed7ee13-a21f-4508-9ad7-21cfda95903b'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:01:20 devstack cinder-volume[87128]: WARNING cinder.quota [None req-862c6fa5-d3b6-4df4-a00f-7a97d72dc863 tempest-GroupSnapshotsTest-772471291 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1429648582 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1429648582, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:01:20 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-862c6fa5-d3b6-4df4-a00f-7a97d72dc863 tempest-GroupSnapshotsTest-772471291 None] Created reservations ['7f665881-053f-41b4-b72c-d897c0d18c83', '27b6a09f-c393-4b3b-8b94-d12fdeb6eef3', '7f0afe8e-8df7-462f-ad74-2f1f6a372651', '20bf8c2f-8ae5-4dc9-9944-3f621e772378'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:01:21 devstack sudo[92872]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4b0dd1b9-f950-4b67-8164-2559c0a4cac2 tempest-VolumesTestJSON-1753717260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78b087e8-735a-4dfc-9eb6-c101c483e764" returned: 0 in 0.776s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:21 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4b0dd1b9-f950-4b67-8164-2559c0a4cac2 tempest-VolumesTestJSON-1753717260 None] Lock "cinder-quobyte-78b087e8-735a-4dfc-9eb6-c101c483e764" released by "delete_volume" :: held 1.703s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:21 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-862c6fa5-d3b6-4df4-a00f-7a97d72dc863 tempest-GroupSnapshotsTest-772471291 None] Created reservations ['d4b7791f-355a-430d-add0-58d4a74ea0e6', 'f6c13f0f-433b-4acf-95e1-dfa30e5fbdac', '374060f8-46c0-4777-ada1-c7acb9cff944', 'ae2d69fc-862b-4304-82bd-efa100986e21'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:01:21 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-4b0dd1b9-f950-4b67-8164-2559c0a4cac2 tempest-VolumesTestJSON-1753717260 None] Created reservations ['a1b99c35-7aeb-46c7-b3b2-80e04d51ba19', '20e1a4a6-bb69-4807-8f45-2945c104ea23', '837eb19d-f562-4eef-96b8-89e7bbdd5749', 'a2d43db7-c8bb-4e56-b260-ee2116b06d48'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:01:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-862c6fa5-d3b6-4df4-a00f-7a97d72dc863 tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-862c6fa5-d3b6-4df4-a00f-7a97d72dc863 tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-862c6fa5-d3b6-4df4-a00f-7a97d72dc863 tempest-GroupSnapshotsTest-772471291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-862c6fa5-d3b6-4df4-a00f-7a97d72dc863 tempest-GroupSnapshotsTest-772471291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-862c6fa5-d3b6-4df4-a00f-7a97d72dc863 tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-862c6fa5-d3b6-4df4-a00f-7a97d72dc863 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4b0dd1b9-f950-4b67-8164-2559c0a4cac2 tempest-VolumesTestJSON-1753717260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4b0dd1b9-f950-4b67-8164-2559c0a4cac2 tempest-VolumesTestJSON-1753717260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4b0dd1b9-f950-4b67-8164-2559c0a4cac2 tempest-VolumesTestJSON-1753717260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4b0dd1b9-f950-4b67-8164-2559c0a4cac2 tempest-VolumesTestJSON-1753717260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4b0dd1b9-f950-4b67-8164-2559c0a4cac2 tempest-VolumesTestJSON-1753717260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4b0dd1b9-f950-4b67-8164-2559c0a4cac2 tempest-VolumesTestJSON-1753717260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:21 devstack sudo[92888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:01:21 devstack sudo[92888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:21 devstack sudo[92890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:01:21 devstack sudo[92890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:21 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0bf9cb0a-ea2a-4e48-831f-2ba148449ba3 tempest-VolumesTestJSON-1753717260 None] Acquiring lock "cinder-689632c3-e03b-4c2a-8460-01d46f95199e-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:22 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0bf9cb0a-ea2a-4e48-831f-2ba148449ba3 tempest-VolumesTestJSON-1753717260 None] Lock "cinder-689632c3-e03b-4c2a-8460-01d46f95199e-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:22 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0bf9cb0a-ea2a-4e48-831f-2ba148449ba3 tempest-VolumesTestJSON-1753717260 None] Acquiring lock "cinder-quobyte-689632c3-e03b-4c2a-8460-01d46f95199e" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:22 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0bf9cb0a-ea2a-4e48-831f-2ba148449ba3 tempest-VolumesTestJSON-1753717260 None] Lock "cinder-quobyte-689632c3-e03b-4c2a-8460-01d46f95199e" acquired by "delete_volume" :: waited 0.055s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:22 devstack sudo[92888]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-862c6fa5-d3b6-4df4-a00f-7a97d72dc863 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.872s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:22 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-862c6fa5-d3b6-4df4-a00f-7a97d72dc863 tempest-GroupSnapshotsTest-772471291 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:01:22 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-862c6fa5-d3b6-4df4-a00f-7a97d72dc863 tempest-GroupSnapshotsTest-772471291 None] Delete group completed successfully. Sep 01 02:01:22 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1182ac7-450e-464d-8bd8-e648f19c7ccb]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0bf9cb0a-ea2a-4e48-831f-2ba148449ba3 tempest-VolumesTestJSON-1753717260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-689632c3-e03b-4c2a-8460-01d46f95199e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:22 devstack sudo[92890]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4b0dd1b9-f950-4b67-8164-2559c0a4cac2 tempest-VolumesTestJSON-1753717260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 1.089s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:22 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-4b0dd1b9-f950-4b67-8164-2559c0a4cac2 tempest-VolumesTestJSON-1753717260 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:01:22 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-4b0dd1b9-f950-4b67-8164-2559c0a4cac2 tempest-VolumesTestJSON-1753717260 None] Deleted volume successfully. Sep 01 02:01:22 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4b0dd1b9-f950-4b67-8164-2559c0a4cac2 tempest-VolumesTestJSON-1753717260 None] Lock "cinder-78b087e8-735a-4dfc-9eb6-c101c483e764-delete_volume" released by "delete_volume" :: held 3.340s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:22 devstack sudo[92894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-689632c3-e03b-4c2a-8460-01d46f95199e Sep 01 02:01:22 devstack sudo[92894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:22 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-14294692-241a-469d-9877-38b7e00a3215 tempest-GroupSnapshotsTest-772471291 None] Group tempest-GroupSnapshotsTest-Group-993493761: creating Sep 01 02:01:22 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-14294692-241a-469d-9877-38b7e00a3215 tempest-GroupSnapshotsTest-772471291 None] Group tempest-GroupSnapshotsTest-Group-993493761: created successfully Sep 01 02:01:23 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-14294692-241a-469d-9877-38b7e00a3215 tempest-GroupSnapshotsTest-772471291 None] Create group completed successfully. Sep 01 02:01:23 devstack sudo[92894]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0bf9cb0a-ea2a-4e48-831f-2ba148449ba3 tempest-VolumesTestJSON-1753717260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-689632c3-e03b-4c2a-8460-01d46f95199e" returned: 0 in 0.880s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0bf9cb0a-ea2a-4e48-831f-2ba148449ba3 tempest-VolumesTestJSON-1753717260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-689632c3-e03b-4c2a-8460-01d46f95199e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:23 devstack sudo[92901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-689632c3-e03b-4c2a-8460-01d46f95199e Sep 01 02:01:23 devstack sudo[92901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:23 devstack sudo[92901]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0bf9cb0a-ea2a-4e48-831f-2ba148449ba3 tempest-VolumesTestJSON-1753717260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-689632c3-e03b-4c2a-8460-01d46f95199e" returned: 0 in 0.259s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0bf9cb0a-ea2a-4e48-831f-2ba148449ba3 tempest-VolumesTestJSON-1753717260 None] Lock "cinder-quobyte-689632c3-e03b-4c2a-8460-01d46f95199e" released by "delete_volume" :: held 1.276s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:23 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-0bf9cb0a-ea2a-4e48-831f-2ba148449ba3 tempest-VolumesTestJSON-1753717260 None] Created reservations ['6dfa56b7-4925-497b-8061-1a4402ece9fc', '9908b99e-e349-4166-b5c5-6ddc60d14b93', '6abd52c8-34cc-42f6-ab00-b890ec886930', '2027c044-c676-4b45-aade-4497296eb831'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:01:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0bf9cb0a-ea2a-4e48-831f-2ba148449ba3 tempest-VolumesTestJSON-1753717260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0bf9cb0a-ea2a-4e48-831f-2ba148449ba3 tempest-VolumesTestJSON-1753717260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:23 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0bf9cb0a-ea2a-4e48-831f-2ba148449ba3 tempest-VolumesTestJSON-1753717260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:23 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0bf9cb0a-ea2a-4e48-831f-2ba148449ba3 tempest-VolumesTestJSON-1753717260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0bf9cb0a-ea2a-4e48-831f-2ba148449ba3 tempest-VolumesTestJSON-1753717260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0bf9cb0a-ea2a-4e48-831f-2ba148449ba3 tempest-VolumesTestJSON-1753717260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:23 devstack sudo[92904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:01:23 devstack sudo[92904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:23 devstack sudo[92904]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0bf9cb0a-ea2a-4e48-831f-2ba148449ba3 tempest-VolumesTestJSON-1753717260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.306s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:23 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-0bf9cb0a-ea2a-4e48-831f-2ba148449ba3 tempest-VolumesTestJSON-1753717260 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:01:23 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-0bf9cb0a-ea2a-4e48-831f-2ba148449ba3 tempest-VolumesTestJSON-1753717260 None] Deleted volume successfully. Sep 01 02:01:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0bf9cb0a-ea2a-4e48-831f-2ba148449ba3 tempest-VolumesTestJSON-1753717260 None] Lock "cinder-689632c3-e03b-4c2a-8460-01d46f95199e-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:24 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:01:24 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] Flow 'volume_create_manager' (c16ac0d1-9b55-4a3a-93a3-12308e5d32f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:24 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4daf2650-ef99-4cba-9380-c16f1973380c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4daf2650-ef99-4cba-9380-c16f1973380c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-26967565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9e5c01ec-25cc-4528-bb1b-0e6c6af53f83,host='devstack@QuobyteHD#QuobyteHD',id=0b5d6b3d-90ea-45b0-8b64-1dba0176bcda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b0b9e0db9e84d03afbb82b02b63d321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:01:25Z,use_quota=True,user_id='eaa1d30d16124f3a984e586c2dab8bb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(237920b6-cdff-499b-b32d-6633526f3bf0),volume_type_id=237920b6-cdff-499b-b32d-6633526f3bf0)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23067a3c-7e60-4d61-b495-4c5db25b58f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23067a3c-7e60-4d61-b495-4c5db25b58f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (730d8683-ec36-442b-8f96-6cf989531b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (730d8683-ec36-442b-8f96-6cf989531b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b5d6b3d-90ea-45b0-8b64-1dba0176bcda', 'volume_name': 'volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d49354e3-6ae4-475d-b54c-7dba31c892e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d49354e3-6ae4-475d-b54c-7dba31c892e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5a79f1-0467-4277-aae7-c5620230a022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:25 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] Volume 0b5d6b3d-90ea-45b0-8b64-1dba0176bcda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda', 'volume_size': 1} Sep 01 02:01:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9e5c01ec-25cc-4528-bb1b-0e6c6af53f83,created_at=2026-09-01T00:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-26967565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9e5c01ec-25cc-4528-bb1b-0e6c6af53f83,host='devstack@QuobyteHD#QuobyteHD',id=0b5d6b3d-90ea-45b0-8b64-1dba0176bcda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b0b9e0db9e84d03afbb82b02b63d321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:01:25Z,use_quota=True,user_id='eaa1d30d16124f3a984e586c2dab8bb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(237920b6-cdff-499b-b32d-6633526f3bf0),volume_type_id=237920b6-cdff-499b-b32d-6633526f3bf0)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:01:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] Creating volume 0b5d6b3d-90ea-45b0-8b64-1dba0176bcda {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:01:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:01:25 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:01:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:25 devstack sudo[92909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda 1073741824 Sep 01 02:01:25 devstack sudo[92909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:25 devstack sudo[92909]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda 1073741824" returned: 0 in 0.604s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:25 devstack sudo[92915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda Sep 01 02:01:25 devstack sudo[92915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:26 devstack sudo[92915]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda" returned: 0 in 0.452s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:26 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:01:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5a79f1-0467-4277-aae7-c5620230a022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (762308f9-fa31-47f1-8bdd-356d55ed2480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:26 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] Volume volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda (0b5d6b3d-90ea-45b0-8b64-1dba0176bcda): created successfully Sep 01 02:01:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (762308f9-fa31-47f1-8bdd-356d55ed2480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] Flow 'volume_create_manager' (c16ac0d1-9b55-4a3a-93a3-12308e5d32f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:26 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-90aebd69-0f4d-4dc0-bec2-8c64d5dc110c tempest-GroupSnapshotsTest-772471291 None] Created volume successfully. Sep 01 02:01:27 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-4fcbd2ac-2a6b-485a-b0b2-c53b65da8933 tempest-GroupSnapshotsTest-772471291 None] GroupSnapshot 670aa67a-8327-4141-bd7d-ade60bc6e9d4: creating. Sep 01 02:01:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4fcbd2ac-2a6b-485a-b0b2-c53b65da8933 tempest-GroupSnapshotsTest-772471291 None] Group snapshot 670aa67a-8327-4141-bd7d-ade60bc6e9d4: creating. {{(pid=87128) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 02:01:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4fcbd2ac-2a6b-485a-b0b2-c53b65da8933 tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4fcbd2ac-2a6b-485a-b0b2-c53b65da8933 tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-4fcbd2ac-2a6b-485a-b0b2-c53b65da8933 tempest-GroupSnapshotsTest-772471291 None] Creating offline snapshot d1f12647-1b35-4d00-9707-b64eb39f3958 of volume 0b5d6b3d-90ea-45b0-8b64-1dba0176bcda {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:01:27 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d4e963-71d2-4a93-a7d0-fd56f27e8900]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4fcbd2ac-2a6b-485a-b0b2-c53b65da8933 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:28 devstack sudo[92948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda Sep 01 02:01:28 devstack sudo[92948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:28 devstack sudo[92948]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4fcbd2ac-2a6b-485a-b0b2-c53b65da8933 tempest-GroupSnapshotsTest-772471291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda" returned: 0 in 0.495s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4fcbd2ac-2a6b-485a-b0b2-c53b65da8933 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda.d1f12647-1b35-4d00-9707-b64eb39f3958 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:28 devstack sudo[92955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda.d1f12647-1b35-4d00-9707-b64eb39f3958 1G Sep 01 02:01:28 devstack sudo[92955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:29 devstack sudo[92955]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4fcbd2ac-2a6b-485a-b0b2-c53b65da8933 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda.d1f12647-1b35-4d00-9707-b64eb39f3958 1G" returned: 0 in 0.621s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4fcbd2ac-2a6b-485a-b0b2-c53b65da8933 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda.d1f12647-1b35-4d00-9707-b64eb39f3958 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:29 devstack sudo[92963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda.d1f12647-1b35-4d00-9707-b64eb39f3958 Sep 01 02:01:29 devstack sudo[92963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:29 devstack sudo[92963]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4fcbd2ac-2a6b-485a-b0b2-c53b65da8933 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda.d1f12647-1b35-4d00-9707-b64eb39f3958" returned: 0 in 0.398s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:29 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-4fcbd2ac-2a6b-485a-b0b2-c53b65da8933 tempest-GroupSnapshotsTest-772471291 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda.d1f12647-1b35-4d00-9707-b64eb39f3958 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:01:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4fcbd2ac-2a6b-485a-b0b2-c53b65da8933 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda.d1f12647-1b35-4d00-9707-b64eb39f3958 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:29 devstack sudo[92970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda.d1f12647-1b35-4d00-9707-b64eb39f3958 Sep 01 02:01:29 devstack sudo[92970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:29 devstack sudo[92970]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4fcbd2ac-2a6b-485a-b0b2-c53b65da8933 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda.d1f12647-1b35-4d00-9707-b64eb39f3958" returned: 0 in 0.316s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4fcbd2ac-2a6b-485a-b0b2-c53b65da8933 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:29 devstack sudo[92974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda.info Sep 01 02:01:29 devstack sudo[92974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:30 devstack sudo[92974]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4fcbd2ac-2a6b-485a-b0b2-c53b65da8933 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda.info" returned: 0 in 0.329s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:30 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-4fcbd2ac-2a6b-485a-b0b2-c53b65da8933 tempest-GroupSnapshotsTest-772471291 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:01:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4fcbd2ac-2a6b-485a-b0b2-c53b65da8933 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:30 devstack sudo[92984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda.info Sep 01 02:01:30 devstack sudo[92984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:30 devstack sudo[92984]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4fcbd2ac-2a6b-485a-b0b2-c53b65da8933 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda.info" returned: 0 in 0.262s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4fcbd2ac-2a6b-485a-b0b2-c53b65da8933 tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.546s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:30 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-4fcbd2ac-2a6b-485a-b0b2-c53b65da8933 tempest-GroupSnapshotsTest-772471291 None] group_snapshot 670aa67a-8327-4141-bd7d-ade60bc6e9d4: created successfully Sep 01 02:01:31 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-28eb1d8f-c89b-4d5e-b393-c8dea0dd748f tempest-GroupSnapshotsTest-772471291 None] group_snapshot 670aa67a-8327-4141-bd7d-ade60bc6e9d4: deleting Sep 01 02:01:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-28eb1d8f-c89b-4d5e-b393-c8dea0dd748f tempest-GroupSnapshotsTest-772471291 None] group_snapshot 670aa67a-8327-4141-bd7d-ade60bc6e9d4: deleting {{(pid=87128) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 02:01:31 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-28eb1d8f-c89b-4d5e-b393-c8dea0dd748f tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "cinder-quobyte-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:31 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-28eb1d8f-c89b-4d5e-b393-c8dea0dd748f tempest-GroupSnapshotsTest-772471291 None] Lock "cinder-quobyte-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:31 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-28eb1d8f-c89b-4d5e-b393-c8dea0dd748f tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "cinder-quobyte-d1f12647-1b35-4d00-9707-b64eb39f3958" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:31 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-28eb1d8f-c89b-4d5e-b393-c8dea0dd748f tempest-GroupSnapshotsTest-772471291 None] Lock "cinder-quobyte-d1f12647-1b35-4d00-9707-b64eb39f3958" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:31 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-28eb1d8f-c89b-4d5e-b393-c8dea0dd748f tempest-GroupSnapshotsTest-772471291 None] Deleting offline snapshot d1f12647-1b35-4d00-9707-b64eb39f3958 of volume 0b5d6b3d-90ea-45b0-8b64-1dba0176bcda {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:01:31 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-28eb1d8f-c89b-4d5e-b393-c8dea0dd748f tempest-GroupSnapshotsTest-772471291 None] snapshot_file for this snap is: volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda.d1f12647-1b35-4d00-9707-b64eb39f3958 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:01:31 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[184b5793-71b4-4187-a947-f1a1919eba86]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-28eb1d8f-c89b-4d5e-b393-c8dea0dd748f tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda.d1f12647-1b35-4d00-9707-b64eb39f3958 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:31 devstack sudo[92988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda.d1f12647-1b35-4d00-9707-b64eb39f3958 Sep 01 02:01:31 devstack sudo[92988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:31 devstack sudo[92988]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-28eb1d8f-c89b-4d5e-b393-c8dea0dd748f tempest-GroupSnapshotsTest-772471291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda.d1f12647-1b35-4d00-9707-b64eb39f3958" returned: 0 in 0.425s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:31 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-28eb1d8f-c89b-4d5e-b393-c8dea0dd748f tempest-GroupSnapshotsTest-772471291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:01:32 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c6b2ab-be1b-46ba-a816-55c4c8c44b4e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-28eb1d8f-c89b-4d5e-b393-c8dea0dd748f tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:32 devstack sudo[92993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda Sep 01 02:01:32 devstack sudo[92993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:32 devstack sudo[92993]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-28eb1d8f-c89b-4d5e-b393-c8dea0dd748f tempest-GroupSnapshotsTest-772471291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda" returned: 0 in 0.438s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-28eb1d8f-c89b-4d5e-b393-c8dea0dd748f tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda.d1f12647-1b35-4d00-9707-b64eb39f3958 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:32 devstack sudo[92998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda.d1f12647-1b35-4d00-9707-b64eb39f3958 Sep 01 02:01:32 devstack sudo[92998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:32 devstack sudo[92998]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-28eb1d8f-c89b-4d5e-b393-c8dea0dd748f tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda.d1f12647-1b35-4d00-9707-b64eb39f3958" returned: 0 in 0.390s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-28eb1d8f-c89b-4d5e-b393-c8dea0dd748f tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda.d1f12647-1b35-4d00-9707-b64eb39f3958 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:32 devstack sudo[93004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda.d1f12647-1b35-4d00-9707-b64eb39f3958 Sep 01 02:01:32 devstack sudo[93004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:33 devstack sudo[93004]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-28eb1d8f-c89b-4d5e-b393-c8dea0dd748f tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda.d1f12647-1b35-4d00-9707-b64eb39f3958" returned: 0 in 0.291s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:33 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-28eb1d8f-c89b-4d5e-b393-c8dea0dd748f tempest-GroupSnapshotsTest-772471291 None] Lock "cinder-quobyte-d1f12647-1b35-4d00-9707-b64eb39f3958" released by "_delete_snapshot" :: held 1.694s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:33 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-28eb1d8f-c89b-4d5e-b393-c8dea0dd748f tempest-GroupSnapshotsTest-772471291 None] Lock "cinder-quobyte-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda" released by "delete_snapshot" :: held 1.746s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:33 devstack cinder-volume[87128]: WARNING cinder.quota [None req-28eb1d8f-c89b-4d5e-b393-c8dea0dd748f tempest-GroupSnapshotsTest-772471291 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1663242513 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1663242513, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:01:33 devstack cinder-volume[87128]: WARNING cinder.quota [None req-28eb1d8f-c89b-4d5e-b393-c8dea0dd748f tempest-GroupSnapshotsTest-772471291 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1663242513 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1663242513, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:01:33 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-28eb1d8f-c89b-4d5e-b393-c8dea0dd748f tempest-GroupSnapshotsTest-772471291 None] Created reservations ['9a3b8456-0f96-4202-a942-6a95fa922416', '2d1c3e5a-49e6-41c6-83d7-cce67510d890', '394dbc7b-f6b0-4ef3-923a-2ba33cd82b4c', 'e7bd0c00-674e-44dd-b877-7486ede2fb89'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:01:33 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-28eb1d8f-c89b-4d5e-b393-c8dea0dd748f tempest-GroupSnapshotsTest-772471291 None] group_snapshot 670aa67a-8327-4141-bd7d-ade60bc6e9d4: deleted successfully Sep 01 02:01:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-302ed87e-8cdf-4907-8566-4b264e627666 tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "cinder-quobyte-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-302ed87e-8cdf-4907-8566-4b264e627666 tempest-GroupSnapshotsTest-772471291 None] Lock "cinder-quobyte-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda" acquired by "delete_volume" :: waited 0.038s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:34 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[23884c48-9976-4d29-8b58-3a72c7fd933f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-302ed87e-8cdf-4907-8566-4b264e627666 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:34 devstack sudo[93008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda Sep 01 02:01:34 devstack sudo[93008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:34 devstack sudo[93008]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-302ed87e-8cdf-4907-8566-4b264e627666 tempest-GroupSnapshotsTest-772471291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda" returned: 0 in 0.509s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-302ed87e-8cdf-4907-8566-4b264e627666 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:34 devstack sudo[93024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda Sep 01 02:01:34 devstack sudo[93024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:35 devstack sudo[93024]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-302ed87e-8cdf-4907-8566-4b264e627666 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda" returned: 0 in 0.355s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-302ed87e-8cdf-4907-8566-4b264e627666 tempest-GroupSnapshotsTest-772471291 None] Lock "cinder-quobyte-0b5d6b3d-90ea-45b0-8b64-1dba0176bcda" released by "delete_volume" :: held 0.965s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:35 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-302ed87e-8cdf-4907-8566-4b264e627666 tempest-GroupSnapshotsTest-772471291 None] Created reservations ['6fed5c0a-3ede-456c-9a3e-9e0c320a78ca'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:01:35 devstack cinder-volume[87128]: WARNING cinder.quota [None req-302ed87e-8cdf-4907-8566-4b264e627666 tempest-GroupSnapshotsTest-772471291 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1663242513 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1663242513, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:01:35 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-302ed87e-8cdf-4907-8566-4b264e627666 tempest-GroupSnapshotsTest-772471291 None] Created reservations ['4cd554ae-5b7b-473a-a5fe-f79379566135', 'e9f030ca-fab1-445a-98dd-3871ba6eaf19', '2a24e549-a509-4ef0-885f-bdcf5229bfc3', '7b8a4258-8b08-42ec-9d65-61f368c0b253'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:01:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-302ed87e-8cdf-4907-8566-4b264e627666 tempest-GroupSnapshotsTest-772471291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-302ed87e-8cdf-4907-8566-4b264e627666 tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:35 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-302ed87e-8cdf-4907-8566-4b264e627666 tempest-GroupSnapshotsTest-772471291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:35 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-302ed87e-8cdf-4907-8566-4b264e627666 tempest-GroupSnapshotsTest-772471291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-302ed87e-8cdf-4907-8566-4b264e627666 tempest-GroupSnapshotsTest-772471291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-302ed87e-8cdf-4907-8566-4b264e627666 tempest-GroupSnapshotsTest-772471291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:35 devstack sudo[93035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:01:35 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:35 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-302ed87e-8cdf-4907-8566-4b264e627666 tempest-GroupSnapshotsTest-772471291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.280s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:35 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-302ed87e-8cdf-4907-8566-4b264e627666 tempest-GroupSnapshotsTest-772471291 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:01:35 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-302ed87e-8cdf-4907-8566-4b264e627666 tempest-GroupSnapshotsTest-772471291 None] Delete group completed successfully. Sep 01 02:01:42 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-ba055ab4-7baa-4168-beed-140f218a8150 req-6b91658f-5d69-418f-a2bb-1c8664e2fa12 tempest-ServerActionsTestOtherA-1922255062 None] Terminate volume connection completed successfully. Sep 01 02:01:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-ba055ab4-7baa-4168-beed-140f218a8150 req-6b91658f-5d69-418f-a2bb-1c8664e2fa12 tempest-ServerActionsTestOtherA-1922255062 None] Deleting attachment 38720ed9-ad56-4773-a347-91f66b966355. {{(pid=87128) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:01:43 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-ba055ab4-7baa-4168-beed-140f218a8150 req-97e1d11b-9705-42b7-bc19-ce5dd3dd0884 tempest-ServerActionsTestOtherA-1922255062 None] Acquiring lock "cinder-e4b718bb-36a0-4ac8-a202-77b2127c453a-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:43 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-ba055ab4-7baa-4168-beed-140f218a8150 req-97e1d11b-9705-42b7-bc19-ce5dd3dd0884 tempest-ServerActionsTestOtherA-1922255062 None] Lock "cinder-e4b718bb-36a0-4ac8-a202-77b2127c453a-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:43 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-ba055ab4-7baa-4168-beed-140f218a8150 req-97e1d11b-9705-42b7-bc19-ce5dd3dd0884 tempest-ServerActionsTestOtherA-1922255062 None] Acquiring lock "cinder-quobyte-e4b718bb-36a0-4ac8-a202-77b2127c453a" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:43 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-ba055ab4-7baa-4168-beed-140f218a8150 req-97e1d11b-9705-42b7-bc19-ce5dd3dd0884 tempest-ServerActionsTestOtherA-1922255062 None] Lock "cinder-quobyte-e4b718bb-36a0-4ac8-a202-77b2127c453a" acquired by "delete_volume" :: waited 0.015s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:43 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:01:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] Flow 'volume_create_manager' (c4aebb9d-9548-48f3-859f-4788375bf0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f7a777-6c9f-4bf0-90dd-44579e44abf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:43 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[160c88fc-9acb-43d0-924e-3f2a4d591a91]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-ba055ab4-7baa-4168-beed-140f218a8150 req-97e1d11b-9705-42b7-bc19-ce5dd3dd0884 tempest-ServerActionsTestOtherA-1922255062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e4b718bb-36a0-4ac8-a202-77b2127c453a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f7a777-6c9f-4bf0-90dd-44579e44abf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2127975412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae1648ab-8597-4be8-affd-f222b2c836f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a501fd3f561422aa1fab98058b97e44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:01:43Z,use_quota=True,user_id='5059431511fe4981a06442a61c024eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (303d124f-6484-4295-a9be-34e18ee5f540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (303d124f-6484-4295-a9be-34e18ee5f540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe003efb-487d-4dfb-8614-05a139b8cbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe003efb-487d-4dfb-8614-05a139b8cbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae1648ab-8597-4be8-affd-f222b2c836f9', 'volume_name': 'volume-ae1648ab-8597-4be8-affd-f222b2c836f9', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec0b407-837d-4203-9178-2bb2b3f7b76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec0b407-837d-4203-9178-2bb2b3f7b76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47306f8-950e-446f-9fbb-f177b0358540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:43 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] Volume ae1648ab-8597-4be8-affd-f222b2c836f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae1648ab-8597-4be8-affd-f222b2c836f9', 'volume_size': 1} Sep 01 02:01:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:43 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2127975412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae1648ab-8597-4be8-affd-f222b2c836f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a501fd3f561422aa1fab98058b97e44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:01:43Z,use_quota=True,user_id='5059431511fe4981a06442a61c024eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:01:43 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] Creating volume ae1648ab-8597-4be8-affd-f222b2c836f9 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:01:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:43 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:43 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:43 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:01:43 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:01:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:43 devstack sudo[93079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e4b718bb-36a0-4ac8-a202-77b2127c453a Sep 01 02:01:43 devstack sudo[93079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:43 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9 1073741824 Sep 01 02:01:43 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:44 devstack sudo[93079]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-ba055ab4-7baa-4168-beed-140f218a8150 req-97e1d11b-9705-42b7-bc19-ce5dd3dd0884 tempest-ServerActionsTestOtherA-1922255062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e4b718bb-36a0-4ac8-a202-77b2127c453a" returned: 0 in 0.528s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-ba055ab4-7baa-4168-beed-140f218a8150 req-97e1d11b-9705-42b7-bc19-ce5dd3dd0884 tempest-ServerActionsTestOtherA-1922255062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e4b718bb-36a0-4ac8-a202-77b2127c453a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:44 devstack sudo[93090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e4b718bb-36a0-4ac8-a202-77b2127c453a Sep 01 02:01:44 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:44 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9 1073741824" returned: 0 in 0.885s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:44 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-ba055ab4-7baa-4168-beed-140f218a8150 req-97e1d11b-9705-42b7-bc19-ce5dd3dd0884 tempest-ServerActionsTestOtherA-1922255062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e4b718bb-36a0-4ac8-a202-77b2127c453a" returned: 0 in 0.496s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:44 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-ba055ab4-7baa-4168-beed-140f218a8150 req-97e1d11b-9705-42b7-bc19-ce5dd3dd0884 tempest-ServerActionsTestOtherA-1922255062 None] Lock "cinder-quobyte-e4b718bb-36a0-4ac8-a202-77b2127c453a" released by "delete_volume" :: held 1.169s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:44 devstack cinder-volume[87128]: DEBUG cinder.quota [req-ba055ab4-7baa-4168-beed-140f218a8150 req-97e1d11b-9705-42b7-bc19-ce5dd3dd0884 tempest-ServerActionsTestOtherA-1922255062 None] Created reservations ['a8712464-1334-435c-8196-127a55904081', '5b6b5973-34dd-41be-a6a2-92fa1ce2f164', '4d54bd71-c5f4-4784-9df6-abf9fa8f67ee', '5da8e9ae-412b-4807-bf00-fe4c050f8d19'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:01:44 devstack sudo[93095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9 Sep 01 02:01:44 devstack sudo[93095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-ba055ab4-7baa-4168-beed-140f218a8150 req-97e1d11b-9705-42b7-bc19-ce5dd3dd0884 tempest-ServerActionsTestOtherA-1922255062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-ba055ab4-7baa-4168-beed-140f218a8150 req-97e1d11b-9705-42b7-bc19-ce5dd3dd0884 tempest-ServerActionsTestOtherA-1922255062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:44 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [req-ba055ab4-7baa-4168-beed-140f218a8150 req-97e1d11b-9705-42b7-bc19-ce5dd3dd0884 tempest-ServerActionsTestOtherA-1922255062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:44 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [req-ba055ab4-7baa-4168-beed-140f218a8150 req-97e1d11b-9705-42b7-bc19-ce5dd3dd0884 tempest-ServerActionsTestOtherA-1922255062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-ba055ab4-7baa-4168-beed-140f218a8150 req-97e1d11b-9705-42b7-bc19-ce5dd3dd0884 tempest-ServerActionsTestOtherA-1922255062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-ba055ab4-7baa-4168-beed-140f218a8150 req-97e1d11b-9705-42b7-bc19-ce5dd3dd0884 tempest-ServerActionsTestOtherA-1922255062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:44 devstack sudo[93098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:01:44 devstack sudo[93098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:44 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-034f5214-cf18-4458-8e83-74c2b7930fe7 tempest-ServerActionsTestOtherA-1922255062 None] Acquiring lock "cinder-7932ce89-cde7-4986-823e-7c0631d0b8ee-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:45 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-034f5214-cf18-4458-8e83-74c2b7930fe7 tempest-ServerActionsTestOtherA-1922255062 None] Lock "cinder-7932ce89-cde7-4986-823e-7c0631d0b8ee-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:45 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-034f5214-cf18-4458-8e83-74c2b7930fe7 tempest-ServerActionsTestOtherA-1922255062 None] Acquiring lock "cinder-quobyte-7932ce89-cde7-4986-823e-7c0631d0b8ee" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:45 devstack sudo[93095]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9" returned: 0 in 0.453s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:45 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:01:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:45 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47306f8-950e-446f-9fbb-f177b0358540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae1648ab-8597-4be8-affd-f222b2c836f9', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:45 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdc35ae8-1bd2-4862-be83-d539856ef7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:45 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-034f5214-cf18-4458-8e83-74c2b7930fe7 tempest-ServerActionsTestOtherA-1922255062 None] Lock "cinder-quobyte-7932ce89-cde7-4986-823e-7c0631d0b8ee" acquired by "delete_volume" :: waited 0.096s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:45 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] Volume volume-ae1648ab-8597-4be8-affd-f222b2c836f9 (ae1648ab-8597-4be8-affd-f222b2c836f9): created successfully Sep 01 02:01:45 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdc35ae8-1bd2-4862-be83-d539856ef7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:45 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] Flow 'volume_create_manager' (c4aebb9d-9548-48f3-859f-4788375bf0b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:45 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc373dd-28f6-47d0-b49f-c6522c7c583e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-034f5214-cf18-4458-8e83-74c2b7930fe7 tempest-ServerActionsTestOtherA-1922255062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7932ce89-cde7-4986-823e-7c0631d0b8ee {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:45 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-48622e80-57bc-4fc3-8814-f9c018519ae0 tempest-SnapshotsActionsTest-1669437024 None] Created volume successfully. Sep 01 02:01:45 devstack sudo[93098]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-ba055ab4-7baa-4168-beed-140f218a8150 req-97e1d11b-9705-42b7-bc19-ce5dd3dd0884 tempest-ServerActionsTestOtherA-1922255062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.582s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:45 devstack cinder-volume[87128]: DEBUG cinder.manager [req-ba055ab4-7baa-4168-beed-140f218a8150 req-97e1d11b-9705-42b7-bc19-ce5dd3dd0884 tempest-ServerActionsTestOtherA-1922255062 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:01:45 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-ba055ab4-7baa-4168-beed-140f218a8150 req-97e1d11b-9705-42b7-bc19-ce5dd3dd0884 tempest-ServerActionsTestOtherA-1922255062 None] Deleted volume successfully. Sep 01 02:01:45 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-ba055ab4-7baa-4168-beed-140f218a8150 req-97e1d11b-9705-42b7-bc19-ce5dd3dd0884 tempest-ServerActionsTestOtherA-1922255062 None] Lock "cinder-e4b718bb-36a0-4ac8-a202-77b2127c453a-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:45 devstack sudo[93113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7932ce89-cde7-4986-823e-7c0631d0b8ee Sep 01 02:01:45 devstack sudo[93113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:45 devstack sudo[93113]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-31a8b676-1fb6-4f8b-a2d1-e73a8e30b1b9 tempest-SnapshotsActionsTest-1669437024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-31a8b676-1fb6-4f8b-a2d1-e73a8e30b1b9 tempest-SnapshotsActionsTest-1669437024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-034f5214-cf18-4458-8e83-74c2b7930fe7 tempest-ServerActionsTestOtherA-1922255062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7932ce89-cde7-4986-823e-7c0631d0b8ee" returned: 0 in 0.660s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-034f5214-cf18-4458-8e83-74c2b7930fe7 tempest-ServerActionsTestOtherA-1922255062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7932ce89-cde7-4986-823e-7c0631d0b8ee {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:45 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-31a8b676-1fb6-4f8b-a2d1-e73a8e30b1b9 tempest-SnapshotsActionsTest-1669437024 None] Creating offline snapshot 7c092b4d-d2fa-44fc-896c-514ecd38e871 of volume ae1648ab-8597-4be8-affd-f222b2c836f9 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:01:46 devstack sudo[93129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7932ce89-cde7-4986-823e-7c0631d0b8ee Sep 01 02:01:46 devstack sudo[93129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:46 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b0bb6f-f4eb-4bca-b81b-e5dcddaad03b]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-31a8b676-1fb6-4f8b-a2d1-e73a8e30b1b9 tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:46 devstack sudo[93131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9 Sep 01 02:01:46 devstack sudo[93131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:46 devstack sudo[93131]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-31a8b676-1fb6-4f8b-a2d1-e73a8e30b1b9 tempest-SnapshotsActionsTest-1669437024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9" returned: 0 in 0.437s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:46 devstack sudo[93129]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-31a8b676-1fb6-4f8b-a2d1-e73a8e30b1b9 tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-034f5214-cf18-4458-8e83-74c2b7930fe7 tempest-ServerActionsTestOtherA-1922255062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7932ce89-cde7-4986-823e-7c0631d0b8ee" returned: 0 in 0.520s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:46 devstack sudo[93138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 1G Sep 01 02:01:46 devstack sudo[93138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-034f5214-cf18-4458-8e83-74c2b7930fe7 tempest-ServerActionsTestOtherA-1922255062 None] Lock "cinder-quobyte-7932ce89-cde7-4986-823e-7c0631d0b8ee" released by "delete_volume" :: held 1.297s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:46 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-034f5214-cf18-4458-8e83-74c2b7930fe7 tempest-ServerActionsTestOtherA-1922255062 None] Created reservations ['89b0db7f-c1e1-4272-9249-368d75c7273f', 'f74ff631-f848-4f70-8f81-bac3a929e02d', 'e04db478-1c15-4a62-b08d-00b9ef10f204', 'e074f330-0304-45ea-a559-2cee45b216ac'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:01:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-034f5214-cf18-4458-8e83-74c2b7930fe7 tempest-ServerActionsTestOtherA-1922255062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-034f5214-cf18-4458-8e83-74c2b7930fe7 tempest-ServerActionsTestOtherA-1922255062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-034f5214-cf18-4458-8e83-74c2b7930fe7 tempest-ServerActionsTestOtherA-1922255062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-034f5214-cf18-4458-8e83-74c2b7930fe7 tempest-ServerActionsTestOtherA-1922255062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-034f5214-cf18-4458-8e83-74c2b7930fe7 tempest-ServerActionsTestOtherA-1922255062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-034f5214-cf18-4458-8e83-74c2b7930fe7 tempest-ServerActionsTestOtherA-1922255062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:46 devstack sudo[93143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:01:46 devstack sudo[93143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:47 devstack sudo[93138]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-31a8b676-1fb6-4f8b-a2d1-e73a8e30b1b9 tempest-SnapshotsActionsTest-1669437024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 1G" returned: 0 in 0.603s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-31a8b676-1fb6-4f8b-a2d1-e73a8e30b1b9 tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae1648ab-8597-4be8-affd-f222b2c836f9 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:47 devstack sudo[93148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae1648ab-8597-4be8-affd-f222b2c836f9 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 Sep 01 02:01:47 devstack sudo[93148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:47 devstack sudo[93143]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-034f5214-cf18-4458-8e83-74c2b7930fe7 tempest-ServerActionsTestOtherA-1922255062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.378s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:47 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-034f5214-cf18-4458-8e83-74c2b7930fe7 tempest-ServerActionsTestOtherA-1922255062 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:01:47 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-034f5214-cf18-4458-8e83-74c2b7930fe7 tempest-ServerActionsTestOtherA-1922255062 None] Deleted volume successfully. Sep 01 02:01:47 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-034f5214-cf18-4458-8e83-74c2b7930fe7 tempest-ServerActionsTestOtherA-1922255062 None] Lock "cinder-7932ce89-cde7-4986-823e-7c0631d0b8ee-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:47 devstack sudo[93148]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-31a8b676-1fb6-4f8b-a2d1-e73a8e30b1b9 tempest-SnapshotsActionsTest-1669437024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae1648ab-8597-4be8-affd-f222b2c836f9 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871" returned: 0 in 0.458s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:47 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-31a8b676-1fb6-4f8b-a2d1-e73a8e30b1b9 tempest-SnapshotsActionsTest-1669437024 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 is being set with open permissions: ugo+rw Sep 01 02:01:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-31a8b676-1fb6-4f8b-a2d1-e73a8e30b1b9 tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:47 devstack sudo[93157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 Sep 01 02:01:47 devstack sudo[93157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:48 devstack sudo[93157]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-31a8b676-1fb6-4f8b-a2d1-e73a8e30b1b9 tempest-SnapshotsActionsTest-1669437024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871" returned: 0 in 0.491s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-31a8b676-1fb6-4f8b-a2d1-e73a8e30b1b9 tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:48 devstack sudo[93178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.info Sep 01 02:01:48 devstack sudo[93178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:48 devstack sudo[93178]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-31a8b676-1fb6-4f8b-a2d1-e73a8e30b1b9 tempest-SnapshotsActionsTest-1669437024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.info" returned: 0 in 0.457s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:48 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-31a8b676-1fb6-4f8b-a2d1-e73a8e30b1b9 tempest-SnapshotsActionsTest-1669437024 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.info is being set with open permissions: ugo+rw Sep 01 02:01:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-31a8b676-1fb6-4f8b-a2d1-e73a8e30b1b9 tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:48 devstack sudo[93182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.info Sep 01 02:01:48 devstack sudo[93182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:48 devstack sudo[93182]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-31a8b676-1fb6-4f8b-a2d1-e73a8e30b1b9 tempest-SnapshotsActionsTest-1669437024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.info" returned: 0 in 0.360s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-31a8b676-1fb6-4f8b-a2d1-e73a8e30b1b9 tempest-SnapshotsActionsTest-1669437024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.012s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:49 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-31a8b676-1fb6-4f8b-a2d1-e73a8e30b1b9 tempest-SnapshotsActionsTest-1669437024 None] Create snapshot completed successfully Sep 01 02:01:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1b9aceaf-2a6b-4c90-b004-e55a0bec9087 tempest-SnapshotsActionsTest-1669437024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1b9aceaf-2a6b-4c90-b004-e55a0bec9087 tempest-SnapshotsActionsTest-1669437024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-1b9aceaf-2a6b-4c90-b004-e55a0bec9087 tempest-SnapshotsActionsTest-1669437024 None] Creating offline snapshot b658b04e-6397-433d-81a6-9d0f3e0ecf35 of volume ae1648ab-8597-4be8-affd-f222b2c836f9 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:01:50 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4c99cd-a4be-495d-8185-5b93628fd0c2]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1b9aceaf-2a6b-4c90-b004-e55a0bec9087 tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:50 devstack sudo[93187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 Sep 01 02:01:50 devstack sudo[93187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:50 devstack sudo[93187]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1b9aceaf-2a6b-4c90-b004-e55a0bec9087 tempest-SnapshotsActionsTest-1669437024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871" returned: 0 in 0.532s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:50 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-1b9aceaf-2a6b-4c90-b004-e55a0bec9087 tempest-SnapshotsActionsTest-1669437024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae1648ab-8597-4be8-affd-f222b2c836f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:01:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1b9aceaf-2a6b-4c90-b004-e55a0bec9087 tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.b658b04e-6397-433d-81a6-9d0f3e0ecf35 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:50 devstack sudo[93192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.b658b04e-6397-433d-81a6-9d0f3e0ecf35 1G Sep 01 02:01:50 devstack sudo[93192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-d9573a2e-9f12-4f60-b6f0-33c265c44bbf tempest-AttachVolumeShelveTestJSON-2071670093 None] Acquiring lock "cinder-61d13d43-22d6-4ae1-b9bc-17c7b8f06b73-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-d9573a2e-9f12-4f60-b6f0-33c265c44bbf tempest-AttachVolumeShelveTestJSON-2071670093 None] Lock "cinder-61d13d43-22d6-4ae1-b9bc-17c7b8f06b73-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-d9573a2e-9f12-4f60-b6f0-33c265c44bbf tempest-AttachVolumeShelveTestJSON-2071670093 None] Acquiring lock "cinder-quobyte-61d13d43-22d6-4ae1-b9bc-17c7b8f06b73" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-d9573a2e-9f12-4f60-b6f0-33c265c44bbf tempest-AttachVolumeShelveTestJSON-2071670093 None] Lock "cinder-quobyte-61d13d43-22d6-4ae1-b9bc-17c7b8f06b73" acquired by "delete_volume" :: waited 0.020s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:50 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8dbf42-68af-4503-a03a-c388cf9d921d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d9573a2e-9f12-4f60-b6f0-33c265c44bbf tempest-AttachVolumeShelveTestJSON-2071670093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-61d13d43-22d6-4ae1-b9bc-17c7b8f06b73 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:50 devstack sudo[93194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-61d13d43-22d6-4ae1-b9bc-17c7b8f06b73 Sep 01 02:01:50 devstack sudo[93194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:51 devstack sudo[93192]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1b9aceaf-2a6b-4c90-b004-e55a0bec9087 tempest-SnapshotsActionsTest-1669437024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.b658b04e-6397-433d-81a6-9d0f3e0ecf35 1G" returned: 0 in 0.567s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1b9aceaf-2a6b-4c90-b004-e55a0bec9087 tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.b658b04e-6397-433d-81a6-9d0f3e0ecf35 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:51 devstack sudo[93200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.b658b04e-6397-433d-81a6-9d0f3e0ecf35 Sep 01 02:01:51 devstack sudo[93200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:51 devstack sudo[93194]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d9573a2e-9f12-4f60-b6f0-33c265c44bbf tempest-AttachVolumeShelveTestJSON-2071670093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-61d13d43-22d6-4ae1-b9bc-17c7b8f06b73" returned: 0 in 0.507s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d9573a2e-9f12-4f60-b6f0-33c265c44bbf tempest-AttachVolumeShelveTestJSON-2071670093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-61d13d43-22d6-4ae1-b9bc-17c7b8f06b73 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:51 devstack sudo[93207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-61d13d43-22d6-4ae1-b9bc-17c7b8f06b73 Sep 01 02:01:51 devstack sudo[93207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:51 devstack sudo[93200]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1b9aceaf-2a6b-4c90-b004-e55a0bec9087 tempest-SnapshotsActionsTest-1669437024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.b658b04e-6397-433d-81a6-9d0f3e0ecf35" returned: 0 in 0.405s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:51 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-1b9aceaf-2a6b-4c90-b004-e55a0bec9087 tempest-SnapshotsActionsTest-1669437024 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.b658b04e-6397-433d-81a6-9d0f3e0ecf35 is being set with open permissions: ugo+rw Sep 01 02:01:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1b9aceaf-2a6b-4c90-b004-e55a0bec9087 tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.b658b04e-6397-433d-81a6-9d0f3e0ecf35 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:51 devstack sudo[93207]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d9573a2e-9f12-4f60-b6f0-33c265c44bbf tempest-AttachVolumeShelveTestJSON-2071670093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-61d13d43-22d6-4ae1-b9bc-17c7b8f06b73" returned: 0 in 0.285s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:51 devstack sudo[93214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.b658b04e-6397-433d-81a6-9d0f3e0ecf35 Sep 01 02:01:51 devstack sudo[93214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-d9573a2e-9f12-4f60-b6f0-33c265c44bbf tempest-AttachVolumeShelveTestJSON-2071670093 None] Lock "cinder-quobyte-61d13d43-22d6-4ae1-b9bc-17c7b8f06b73" released by "delete_volume" :: held 0.852s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:51 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-d9573a2e-9f12-4f60-b6f0-33c265c44bbf tempest-AttachVolumeShelveTestJSON-2071670093 None] Created reservations ['dc1fa7c0-587e-4c86-807b-c5668796c88e', '475fe749-76c1-4962-9604-1765a1a92556', '3201c191-cf38-4757-ac28-70dc965bc77d', '83704997-9621-4f3a-8992-af8b5132ade9'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:01:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d9573a2e-9f12-4f60-b6f0-33c265c44bbf tempest-AttachVolumeShelveTestJSON-2071670093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d9573a2e-9f12-4f60-b6f0-33c265c44bbf tempest-AttachVolumeShelveTestJSON-2071670093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:51 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d9573a2e-9f12-4f60-b6f0-33c265c44bbf tempest-AttachVolumeShelveTestJSON-2071670093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:51 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d9573a2e-9f12-4f60-b6f0-33c265c44bbf tempest-AttachVolumeShelveTestJSON-2071670093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d9573a2e-9f12-4f60-b6f0-33c265c44bbf tempest-AttachVolumeShelveTestJSON-2071670093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d9573a2e-9f12-4f60-b6f0-33c265c44bbf tempest-AttachVolumeShelveTestJSON-2071670093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:51 devstack sudo[93216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:01:51 devstack sudo[93216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:51 devstack sudo[93214]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1b9aceaf-2a6b-4c90-b004-e55a0bec9087 tempest-SnapshotsActionsTest-1669437024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.b658b04e-6397-433d-81a6-9d0f3e0ecf35" returned: 0 in 0.344s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1b9aceaf-2a6b-4c90-b004-e55a0bec9087 tempest-SnapshotsActionsTest-1669437024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.968s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:51 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-1b9aceaf-2a6b-4c90-b004-e55a0bec9087 tempest-SnapshotsActionsTest-1669437024 None] Create snapshot completed successfully Sep 01 02:01:52 devstack sudo[93216]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d9573a2e-9f12-4f60-b6f0-33c265c44bbf tempest-AttachVolumeShelveTestJSON-2071670093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.327s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:52 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-d9573a2e-9f12-4f60-b6f0-33c265c44bbf tempest-AttachVolumeShelveTestJSON-2071670093 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:01:52 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-d9573a2e-9f12-4f60-b6f0-33c265c44bbf tempest-AttachVolumeShelveTestJSON-2071670093 None] Deleted volume successfully. Sep 01 02:01:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-d9573a2e-9f12-4f60-b6f0-33c265c44bbf tempest-AttachVolumeShelveTestJSON-2071670093 None] Lock "cinder-61d13d43-22d6-4ae1-b9bc-17c7b8f06b73-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-21a7a4b1-e926-467c-92e0-62cedc2d465f tempest-SnapshotsActionsTest-1798027063 None] Acquiring lock "cinder-b658b04e-6397-433d-81a6-9d0f3e0ecf35-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-21a7a4b1-e926-467c-92e0-62cedc2d465f tempest-SnapshotsActionsTest-1798027063 None] Lock "cinder-b658b04e-6397-433d-81a6-9d0f3e0ecf35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-21a7a4b1-e926-467c-92e0-62cedc2d465f tempest-SnapshotsActionsTest-1798027063 None] Acquiring lock "cinder-quobyte-ae1648ab-8597-4be8-affd-f222b2c836f9" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-21a7a4b1-e926-467c-92e0-62cedc2d465f tempest-SnapshotsActionsTest-1798027063 None] Lock "cinder-quobyte-ae1648ab-8597-4be8-affd-f222b2c836f9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-21a7a4b1-e926-467c-92e0-62cedc2d465f tempest-SnapshotsActionsTest-1798027063 None] Acquiring lock "cinder-quobyte-b658b04e-6397-433d-81a6-9d0f3e0ecf35" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-21a7a4b1-e926-467c-92e0-62cedc2d465f tempest-SnapshotsActionsTest-1798027063 None] Lock "cinder-quobyte-b658b04e-6397-433d-81a6-9d0f3e0ecf35" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:52 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-21a7a4b1-e926-467c-92e0-62cedc2d465f tempest-SnapshotsActionsTest-1798027063 None] Deleting offline snapshot b658b04e-6397-433d-81a6-9d0f3e0ecf35 of volume ae1648ab-8597-4be8-affd-f222b2c836f9 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:01:52 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-21a7a4b1-e926-467c-92e0-62cedc2d465f tempest-SnapshotsActionsTest-1798027063 None] snapshot_file for this snap is: volume-ae1648ab-8597-4be8-affd-f222b2c836f9.b658b04e-6397-433d-81a6-9d0f3e0ecf35 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:01:52 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad1f91e-90d9-44a8-b369-9f2faf8d45a7]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-21a7a4b1-e926-467c-92e0-62cedc2d465f tempest-SnapshotsActionsTest-1798027063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.b658b04e-6397-433d-81a6-9d0f3e0ecf35 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:52 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.b658b04e-6397-433d-81a6-9d0f3e0ecf35 Sep 01 02:01:52 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:52 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-21a7a4b1-e926-467c-92e0-62cedc2d465f tempest-SnapshotsActionsTest-1798027063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.b658b04e-6397-433d-81a6-9d0f3e0ecf35" returned: 0 in 0.398s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:52 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-21a7a4b1-e926-467c-92e0-62cedc2d465f tempest-SnapshotsActionsTest-1798027063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae1648ab-8597-4be8-affd-f222b2c836f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:01:52 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a19bd9d-a701-44a0-8416-7c84fa68f96e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-21a7a4b1-e926-467c-92e0-62cedc2d465f tempest-SnapshotsActionsTest-1798027063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:52 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 Sep 01 02:01:52 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:53 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-21a7a4b1-e926-467c-92e0-62cedc2d465f tempest-SnapshotsActionsTest-1798027063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871" returned: 0 in 0.497s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-21a7a4b1-e926-467c-92e0-62cedc2d465f tempest-SnapshotsActionsTest-1798027063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae1648ab-8597-4be8-affd-f222b2c836f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:01:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-21a7a4b1-e926-467c-92e0-62cedc2d465f tempest-SnapshotsActionsTest-1798027063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.b658b04e-6397-433d-81a6-9d0f3e0ecf35 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:53 devstack sudo[93232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.b658b04e-6397-433d-81a6-9d0f3e0ecf35 Sep 01 02:01:53 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:53 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-21a7a4b1-e926-467c-92e0-62cedc2d465f tempest-SnapshotsActionsTest-1798027063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.b658b04e-6397-433d-81a6-9d0f3e0ecf35" returned: 0 in 0.459s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-21a7a4b1-e926-467c-92e0-62cedc2d465f tempest-SnapshotsActionsTest-1798027063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.b658b04e-6397-433d-81a6-9d0f3e0ecf35 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:53 devstack sudo[93238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.b658b04e-6397-433d-81a6-9d0f3e0ecf35 Sep 01 02:01:53 devstack sudo[93238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:54 devstack sudo[93238]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-21a7a4b1-e926-467c-92e0-62cedc2d465f tempest-SnapshotsActionsTest-1798027063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.b658b04e-6397-433d-81a6-9d0f3e0ecf35" returned: 0 in 0.288s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:54 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-21a7a4b1-e926-467c-92e0-62cedc2d465f tempest-SnapshotsActionsTest-1798027063 None] Lock "cinder-quobyte-b658b04e-6397-433d-81a6-9d0f3e0ecf35" released by "_delete_snapshot" :: held 1.746s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:54 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-21a7a4b1-e926-467c-92e0-62cedc2d465f tempest-SnapshotsActionsTest-1798027063 None] Lock "cinder-quobyte-ae1648ab-8597-4be8-affd-f222b2c836f9" released by "delete_snapshot" :: held 1.773s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:54 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-21a7a4b1-e926-467c-92e0-62cedc2d465f tempest-SnapshotsActionsTest-1798027063 None] Created reservations ['06dadce3-b937-4d8c-860c-55e502c3d4ba', 'a1f272e9-4eea-404a-8137-5d76a1f47bf8', '83efa5bc-7eae-419b-812b-f0b53299acda', 'd63e7434-753a-462b-bc23-ddd7b7a8bce8'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:01:54 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-21a7a4b1-e926-467c-92e0-62cedc2d465f tempest-SnapshotsActionsTest-1798027063 None] Delete snapshot completed successfully. Sep 01 02:01:54 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-21a7a4b1-e926-467c-92e0-62cedc2d465f tempest-SnapshotsActionsTest-1798027063 None] Lock "cinder-b658b04e-6397-433d-81a6-9d0f3e0ecf35-delete_snapshot" released by "delete_snapshot" :: held 2.012s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3217cd69-7caa-4513-979b-6ebe6c93c887 tempest-SnapshotsActionsTest-1669437024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3217cd69-7caa-4513-979b-6ebe6c93c887 tempest-SnapshotsActionsTest-1669437024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-3217cd69-7caa-4513-979b-6ebe6c93c887 tempest-SnapshotsActionsTest-1669437024 None] Creating offline snapshot dc800d55-8e4e-40a2-8191-fd19cbf5d202 of volume ae1648ab-8597-4be8-affd-f222b2c836f9 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:01:54 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6095862-6a04-4c1d-8499-03527c63d2c9]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3217cd69-7caa-4513-979b-6ebe6c93c887 tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:54 devstack sudo[93242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 Sep 01 02:01:54 devstack sudo[93242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:55 devstack sudo[93242]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3217cd69-7caa-4513-979b-6ebe6c93c887 tempest-SnapshotsActionsTest-1669437024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871" returned: 0 in 0.385s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:55 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-3217cd69-7caa-4513-979b-6ebe6c93c887 tempest-SnapshotsActionsTest-1669437024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae1648ab-8597-4be8-affd-f222b2c836f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:01:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3217cd69-7caa-4513-979b-6ebe6c93c887 tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.dc800d55-8e4e-40a2-8191-fd19cbf5d202 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:55 devstack sudo[93247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.dc800d55-8e4e-40a2-8191-fd19cbf5d202 1G Sep 01 02:01:55 devstack sudo[93247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:55 devstack sudo[93247]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3217cd69-7caa-4513-979b-6ebe6c93c887 tempest-SnapshotsActionsTest-1669437024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.dc800d55-8e4e-40a2-8191-fd19cbf5d202 1G" returned: 0 in 0.502s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3217cd69-7caa-4513-979b-6ebe6c93c887 tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.dc800d55-8e4e-40a2-8191-fd19cbf5d202 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:55 devstack sudo[93254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.dc800d55-8e4e-40a2-8191-fd19cbf5d202 Sep 01 02:01:55 devstack sudo[93254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:56 devstack sudo[93254]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3217cd69-7caa-4513-979b-6ebe6c93c887 tempest-SnapshotsActionsTest-1669437024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.dc800d55-8e4e-40a2-8191-fd19cbf5d202" returned: 0 in 0.331s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:56 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-3217cd69-7caa-4513-979b-6ebe6c93c887 tempest-SnapshotsActionsTest-1669437024 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.dc800d55-8e4e-40a2-8191-fd19cbf5d202 is being set with open permissions: ugo+rw Sep 01 02:01:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3217cd69-7caa-4513-979b-6ebe6c93c887 tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.dc800d55-8e4e-40a2-8191-fd19cbf5d202 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:56 devstack sudo[93259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.dc800d55-8e4e-40a2-8191-fd19cbf5d202 Sep 01 02:01:56 devstack sudo[93259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:56 devstack sudo[93259]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3217cd69-7caa-4513-979b-6ebe6c93c887 tempest-SnapshotsActionsTest-1669437024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.dc800d55-8e4e-40a2-8191-fd19cbf5d202" returned: 0 in 0.273s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3217cd69-7caa-4513-979b-6ebe6c93c887 tempest-SnapshotsActionsTest-1669437024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.609s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:56 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-3217cd69-7caa-4513-979b-6ebe6c93c887 tempest-SnapshotsActionsTest-1669437024 None] Create snapshot completed successfully Sep 01 02:01:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-34ed94fd-3dd2-4a47-9ffb-28254b525616 tempest-SnapshotsActionsTest-1798027063 None] Acquiring lock "cinder-dc800d55-8e4e-40a2-8191-fd19cbf5d202-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-34ed94fd-3dd2-4a47-9ffb-28254b525616 tempest-SnapshotsActionsTest-1798027063 None] Lock "cinder-dc800d55-8e4e-40a2-8191-fd19cbf5d202-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-34ed94fd-3dd2-4a47-9ffb-28254b525616 tempest-SnapshotsActionsTest-1798027063 None] Acquiring lock "cinder-quobyte-ae1648ab-8597-4be8-affd-f222b2c836f9" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-34ed94fd-3dd2-4a47-9ffb-28254b525616 tempest-SnapshotsActionsTest-1798027063 None] Lock "cinder-quobyte-ae1648ab-8597-4be8-affd-f222b2c836f9" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-34ed94fd-3dd2-4a47-9ffb-28254b525616 tempest-SnapshotsActionsTest-1798027063 None] Acquiring lock "cinder-quobyte-dc800d55-8e4e-40a2-8191-fd19cbf5d202" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-34ed94fd-3dd2-4a47-9ffb-28254b525616 tempest-SnapshotsActionsTest-1798027063 None] Lock "cinder-quobyte-dc800d55-8e4e-40a2-8191-fd19cbf5d202" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-34ed94fd-3dd2-4a47-9ffb-28254b525616 tempest-SnapshotsActionsTest-1798027063 None] Deleting offline snapshot dc800d55-8e4e-40a2-8191-fd19cbf5d202 of volume ae1648ab-8597-4be8-affd-f222b2c836f9 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:01:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-34ed94fd-3dd2-4a47-9ffb-28254b525616 tempest-SnapshotsActionsTest-1798027063 None] snapshot_file for this snap is: volume-ae1648ab-8597-4be8-affd-f222b2c836f9.dc800d55-8e4e-40a2-8191-fd19cbf5d202 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:01:57 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e184968-41de-4ed6-851a-a9d61e36d6c2]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-34ed94fd-3dd2-4a47-9ffb-28254b525616 tempest-SnapshotsActionsTest-1798027063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.dc800d55-8e4e-40a2-8191-fd19cbf5d202 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:57 devstack sudo[93263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.dc800d55-8e4e-40a2-8191-fd19cbf5d202 Sep 01 02:01:57 devstack sudo[93263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:57 devstack sudo[93263]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-34ed94fd-3dd2-4a47-9ffb-28254b525616 tempest-SnapshotsActionsTest-1798027063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.dc800d55-8e4e-40a2-8191-fd19cbf5d202" returned: 0 in 0.459s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-34ed94fd-3dd2-4a47-9ffb-28254b525616 tempest-SnapshotsActionsTest-1798027063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae1648ab-8597-4be8-affd-f222b2c836f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:01:57 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4784550-8646-41b4-a6a4-3f11ecde69d0]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-34ed94fd-3dd2-4a47-9ffb-28254b525616 tempest-SnapshotsActionsTest-1798027063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:57 devstack sudo[93269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 Sep 01 02:01:57 devstack sudo[93269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:58 devstack sudo[93269]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-34ed94fd-3dd2-4a47-9ffb-28254b525616 tempest-SnapshotsActionsTest-1798027063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871" returned: 0 in 0.474s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-34ed94fd-3dd2-4a47-9ffb-28254b525616 tempest-SnapshotsActionsTest-1798027063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae1648ab-8597-4be8-affd-f222b2c836f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:01:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-34ed94fd-3dd2-4a47-9ffb-28254b525616 tempest-SnapshotsActionsTest-1798027063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.dc800d55-8e4e-40a2-8191-fd19cbf5d202 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:58 devstack sudo[93275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.dc800d55-8e4e-40a2-8191-fd19cbf5d202 Sep 01 02:01:58 devstack sudo[93275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:58 devstack sudo[93275]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-34ed94fd-3dd2-4a47-9ffb-28254b525616 tempest-SnapshotsActionsTest-1798027063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.dc800d55-8e4e-40a2-8191-fd19cbf5d202" returned: 0 in 0.477s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-34ed94fd-3dd2-4a47-9ffb-28254b525616 tempest-SnapshotsActionsTest-1798027063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.dc800d55-8e4e-40a2-8191-fd19cbf5d202 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:58 devstack sudo[93282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.dc800d55-8e4e-40a2-8191-fd19cbf5d202 Sep 01 02:01:58 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:58 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-34ed94fd-3dd2-4a47-9ffb-28254b525616 tempest-SnapshotsActionsTest-1798027063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.dc800d55-8e4e-40a2-8191-fd19cbf5d202" returned: 0 in 0.304s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:59 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-34ed94fd-3dd2-4a47-9ffb-28254b525616 tempest-SnapshotsActionsTest-1798027063 None] Lock "cinder-quobyte-dc800d55-8e4e-40a2-8191-fd19cbf5d202" released by "_delete_snapshot" :: held 1.868s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:59 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-34ed94fd-3dd2-4a47-9ffb-28254b525616 tempest-SnapshotsActionsTest-1798027063 None] Lock "cinder-quobyte-ae1648ab-8597-4be8-affd-f222b2c836f9" released by "delete_snapshot" :: held 1.903s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:59 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-34ed94fd-3dd2-4a47-9ffb-28254b525616 tempest-SnapshotsActionsTest-1798027063 None] Created reservations ['92f7639c-604d-4e66-bc7a-86c680f32d51', '75d94710-bfc2-4a88-a11f-e0562c4331b8', '6428fd31-8be5-40cc-a3e2-21266263239c', '7e27b401-ea3b-4c12-a334-970e6d6f1438'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:01:59 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-34ed94fd-3dd2-4a47-9ffb-28254b525616 tempest-SnapshotsActionsTest-1798027063 None] Delete snapshot completed successfully. Sep 01 02:01:59 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-34ed94fd-3dd2-4a47-9ffb-28254b525616 tempest-SnapshotsActionsTest-1798027063 None] Lock "cinder-dc800d55-8e4e-40a2-8191-fd19cbf5d202-delete_snapshot" released by "delete_snapshot" :: held 2.167s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-902e2838-cfc6-49df-8ca7-275ed7dd1eef tempest-SnapshotsActionsTest-1669437024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-902e2838-cfc6-49df-8ca7-275ed7dd1eef tempest-SnapshotsActionsTest-1669437024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:59 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-902e2838-cfc6-49df-8ca7-275ed7dd1eef tempest-SnapshotsActionsTest-1669437024 None] Creating offline snapshot 29c1b063-2e23-43ae-a32c-9e643642225c of volume ae1648ab-8597-4be8-affd-f222b2c836f9 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:01:59 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[767e97b2-0b47-4b6d-8d04-41adf76288c1]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-902e2838-cfc6-49df-8ca7-275ed7dd1eef tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:59 devstack sudo[93285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 Sep 01 02:01:59 devstack sudo[93285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:00 devstack sudo[93285]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-902e2838-cfc6-49df-8ca7-275ed7dd1eef tempest-SnapshotsActionsTest-1669437024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871" returned: 0 in 0.497s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:00 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-902e2838-cfc6-49df-8ca7-275ed7dd1eef tempest-SnapshotsActionsTest-1669437024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae1648ab-8597-4be8-affd-f222b2c836f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:02:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-902e2838-cfc6-49df-8ca7-275ed7dd1eef tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.29c1b063-2e23-43ae-a32c-9e643642225c 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:00 devstack sudo[93290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.29c1b063-2e23-43ae-a32c-9e643642225c 1G Sep 01 02:02:00 devstack sudo[93290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:00 devstack sudo[93290]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-902e2838-cfc6-49df-8ca7-275ed7dd1eef tempest-SnapshotsActionsTest-1669437024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.29c1b063-2e23-43ae-a32c-9e643642225c 1G" returned: 0 in 0.612s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-902e2838-cfc6-49df-8ca7-275ed7dd1eef tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.29c1b063-2e23-43ae-a32c-9e643642225c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:00 devstack sudo[93297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.29c1b063-2e23-43ae-a32c-9e643642225c Sep 01 02:02:00 devstack sudo[93297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:01 devstack sudo[93297]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-902e2838-cfc6-49df-8ca7-275ed7dd1eef tempest-SnapshotsActionsTest-1669437024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.29c1b063-2e23-43ae-a32c-9e643642225c" returned: 0 in 0.439s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:01 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-902e2838-cfc6-49df-8ca7-275ed7dd1eef tempest-SnapshotsActionsTest-1669437024 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.29c1b063-2e23-43ae-a32c-9e643642225c is being set with open permissions: ugo+rw Sep 01 02:02:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-902e2838-cfc6-49df-8ca7-275ed7dd1eef tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.29c1b063-2e23-43ae-a32c-9e643642225c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:01 devstack sudo[93303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.29c1b063-2e23-43ae-a32c-9e643642225c Sep 01 02:02:01 devstack sudo[93303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:01 devstack sudo[93303]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-902e2838-cfc6-49df-8ca7-275ed7dd1eef tempest-SnapshotsActionsTest-1669437024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.29c1b063-2e23-43ae-a32c-9e643642225c" returned: 0 in 0.307s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-902e2838-cfc6-49df-8ca7-275ed7dd1eef tempest-SnapshotsActionsTest-1669437024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.999s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:01 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-902e2838-cfc6-49df-8ca7-275ed7dd1eef tempest-SnapshotsActionsTest-1669437024 None] Create snapshot completed successfully Sep 01 02:02:02 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-409c674b-d752-47ee-88a5-f96c7c6af27b tempest-SnapshotsActionsTest-1798027063 None] Acquiring lock "cinder-29c1b063-2e23-43ae-a32c-9e643642225c-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:03 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-409c674b-d752-47ee-88a5-f96c7c6af27b tempest-SnapshotsActionsTest-1798027063 None] Lock "cinder-29c1b063-2e23-43ae-a32c-9e643642225c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:03 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-409c674b-d752-47ee-88a5-f96c7c6af27b tempest-SnapshotsActionsTest-1798027063 None] Acquiring lock "cinder-quobyte-ae1648ab-8597-4be8-affd-f222b2c836f9" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:03 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-409c674b-d752-47ee-88a5-f96c7c6af27b tempest-SnapshotsActionsTest-1798027063 None] Lock "cinder-quobyte-ae1648ab-8597-4be8-affd-f222b2c836f9" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:03 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-409c674b-d752-47ee-88a5-f96c7c6af27b tempest-SnapshotsActionsTest-1798027063 None] Acquiring lock "cinder-quobyte-29c1b063-2e23-43ae-a32c-9e643642225c" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:03 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-409c674b-d752-47ee-88a5-f96c7c6af27b tempest-SnapshotsActionsTest-1798027063 None] Lock "cinder-quobyte-29c1b063-2e23-43ae-a32c-9e643642225c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:03 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-409c674b-d752-47ee-88a5-f96c7c6af27b tempest-SnapshotsActionsTest-1798027063 None] Deleting offline snapshot 29c1b063-2e23-43ae-a32c-9e643642225c of volume ae1648ab-8597-4be8-affd-f222b2c836f9 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:02:03 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-409c674b-d752-47ee-88a5-f96c7c6af27b tempest-SnapshotsActionsTest-1798027063 None] snapshot_file for this snap is: volume-ae1648ab-8597-4be8-affd-f222b2c836f9.29c1b063-2e23-43ae-a32c-9e643642225c {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:02:03 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b965122-af2d-479b-9e38-0fa14ef1ef67]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-409c674b-d752-47ee-88a5-f96c7c6af27b tempest-SnapshotsActionsTest-1798027063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.29c1b063-2e23-43ae-a32c-9e643642225c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:03 devstack sudo[93306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.29c1b063-2e23-43ae-a32c-9e643642225c Sep 01 02:02:03 devstack sudo[93306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:03 devstack sudo[93306]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-409c674b-d752-47ee-88a5-f96c7c6af27b tempest-SnapshotsActionsTest-1798027063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.29c1b063-2e23-43ae-a32c-9e643642225c" returned: 0 in 0.457s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:03 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-409c674b-d752-47ee-88a5-f96c7c6af27b tempest-SnapshotsActionsTest-1798027063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae1648ab-8597-4be8-affd-f222b2c836f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:02:03 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0b7864-3722-4fc4-b6e0-1473edfdc764]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-409c674b-d752-47ee-88a5-f96c7c6af27b tempest-SnapshotsActionsTest-1798027063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:03 devstack sudo[93312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 Sep 01 02:02:03 devstack sudo[93312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:04 devstack sudo[93312]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-409c674b-d752-47ee-88a5-f96c7c6af27b tempest-SnapshotsActionsTest-1798027063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871" returned: 0 in 0.466s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:04 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-409c674b-d752-47ee-88a5-f96c7c6af27b tempest-SnapshotsActionsTest-1798027063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae1648ab-8597-4be8-affd-f222b2c836f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:02:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-409c674b-d752-47ee-88a5-f96c7c6af27b tempest-SnapshotsActionsTest-1798027063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.29c1b063-2e23-43ae-a32c-9e643642225c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:04 devstack sudo[93317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.29c1b063-2e23-43ae-a32c-9e643642225c Sep 01 02:02:04 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:04 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-409c674b-d752-47ee-88a5-f96c7c6af27b tempest-SnapshotsActionsTest-1798027063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.29c1b063-2e23-43ae-a32c-9e643642225c" returned: 0 in 0.439s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-409c674b-d752-47ee-88a5-f96c7c6af27b tempest-SnapshotsActionsTest-1798027063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.29c1b063-2e23-43ae-a32c-9e643642225c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:04 devstack sudo[93322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.29c1b063-2e23-43ae-a32c-9e643642225c Sep 01 02:02:04 devstack sudo[93322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:04 devstack sudo[93322]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-409c674b-d752-47ee-88a5-f96c7c6af27b tempest-SnapshotsActionsTest-1798027063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.29c1b063-2e23-43ae-a32c-9e643642225c" returned: 0 in 0.278s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:04 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-409c674b-d752-47ee-88a5-f96c7c6af27b tempest-SnapshotsActionsTest-1798027063 None] Lock "cinder-quobyte-29c1b063-2e23-43ae-a32c-9e643642225c" released by "_delete_snapshot" :: held 1.760s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:04 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-409c674b-d752-47ee-88a5-f96c7c6af27b tempest-SnapshotsActionsTest-1798027063 None] Lock "cinder-quobyte-ae1648ab-8597-4be8-affd-f222b2c836f9" released by "delete_snapshot" :: held 1.788s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:04 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-409c674b-d752-47ee-88a5-f96c7c6af27b tempest-SnapshotsActionsTest-1798027063 None] Created reservations ['4f5d7b22-bdc5-4358-b4f4-9240ab7a9cc0', '414355f8-60e2-45c1-9be7-ad6d265531be', 'd44c8ba4-ae7c-45ee-a916-a1161196b6ea', 'e5d9b54f-c03b-4f73-8ec0-1675ad407b93'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:02:04 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-409c674b-d752-47ee-88a5-f96c7c6af27b tempest-SnapshotsActionsTest-1798027063 None] Delete snapshot completed successfully. Sep 01 02:02:04 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-409c674b-d752-47ee-88a5-f96c7c6af27b tempest-SnapshotsActionsTest-1798027063 None] Lock "cinder-29c1b063-2e23-43ae-a32c-9e643642225c-delete_snapshot" released by "delete_snapshot" :: held 1.974s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-86aa6cd5-5ee2-4321-8322-5ec343435bc4 tempest-SnapshotsActionsTest-1669437024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-86aa6cd5-5ee2-4321-8322-5ec343435bc4 tempest-SnapshotsActionsTest-1669437024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:05 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-86aa6cd5-5ee2-4321-8322-5ec343435bc4 tempest-SnapshotsActionsTest-1669437024 None] Creating offline snapshot c985049e-d0ce-417e-bcac-7923eb2f2d17 of volume ae1648ab-8597-4be8-affd-f222b2c836f9 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:02:05 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a05e2d4-5fe8-4076-bd6c-f2c1e16367a1]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-86aa6cd5-5ee2-4321-8322-5ec343435bc4 tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:05 devstack sudo[93325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 Sep 01 02:02:05 devstack sudo[93325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:06 devstack sudo[93325]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-86aa6cd5-5ee2-4321-8322-5ec343435bc4 tempest-SnapshotsActionsTest-1669437024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871" returned: 0 in 0.438s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:06 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-86aa6cd5-5ee2-4321-8322-5ec343435bc4 tempest-SnapshotsActionsTest-1669437024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae1648ab-8597-4be8-affd-f222b2c836f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:02:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-86aa6cd5-5ee2-4321-8322-5ec343435bc4 tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.c985049e-d0ce-417e-bcac-7923eb2f2d17 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:06 devstack sudo[93330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.c985049e-d0ce-417e-bcac-7923eb2f2d17 1G Sep 01 02:02:06 devstack sudo[93330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:06 devstack sudo[93330]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-86aa6cd5-5ee2-4321-8322-5ec343435bc4 tempest-SnapshotsActionsTest-1669437024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.c985049e-d0ce-417e-bcac-7923eb2f2d17 1G" returned: 0 in 0.602s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-86aa6cd5-5ee2-4321-8322-5ec343435bc4 tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.c985049e-d0ce-417e-bcac-7923eb2f2d17 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:06 devstack sudo[93335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.c985049e-d0ce-417e-bcac-7923eb2f2d17 Sep 01 02:02:06 devstack sudo[93335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:06 devstack sudo[93335]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-86aa6cd5-5ee2-4321-8322-5ec343435bc4 tempest-SnapshotsActionsTest-1669437024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.c985049e-d0ce-417e-bcac-7923eb2f2d17" returned: 0 in 0.301s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:06 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-86aa6cd5-5ee2-4321-8322-5ec343435bc4 tempest-SnapshotsActionsTest-1669437024 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.c985049e-d0ce-417e-bcac-7923eb2f2d17 is being set with open permissions: ugo+rw Sep 01 02:02:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-86aa6cd5-5ee2-4321-8322-5ec343435bc4 tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.c985049e-d0ce-417e-bcac-7923eb2f2d17 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:06 devstack sudo[93340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.c985049e-d0ce-417e-bcac-7923eb2f2d17 Sep 01 02:02:06 devstack sudo[93340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:07 devstack sudo[93340]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-86aa6cd5-5ee2-4321-8322-5ec343435bc4 tempest-SnapshotsActionsTest-1669437024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.c985049e-d0ce-417e-bcac-7923eb2f2d17" returned: 0 in 0.382s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:07 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=123,cinder:UPDATE=146,cinder:INSERT=35,cinder:DELETE=7 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:02:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-86aa6cd5-5ee2-4321-8322-5ec343435bc4 tempest-SnapshotsActionsTest-1669437024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.831s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:07 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-86aa6cd5-5ee2-4321-8322-5ec343435bc4 tempest-SnapshotsActionsTest-1669437024 None] Create snapshot completed successfully Sep 01 02:02:07 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6b7300db-2cc0-49d0-963c-08e3afb64711 tempest-SnapshotsActionsTest-1798027063 None] Acquiring lock "cinder-c985049e-d0ce-417e-bcac-7923eb2f2d17-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:07 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6b7300db-2cc0-49d0-963c-08e3afb64711 tempest-SnapshotsActionsTest-1798027063 None] Lock "cinder-c985049e-d0ce-417e-bcac-7923eb2f2d17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:07 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6b7300db-2cc0-49d0-963c-08e3afb64711 tempest-SnapshotsActionsTest-1798027063 None] Acquiring lock "cinder-quobyte-ae1648ab-8597-4be8-affd-f222b2c836f9" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:07 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6b7300db-2cc0-49d0-963c-08e3afb64711 tempest-SnapshotsActionsTest-1798027063 None] Lock "cinder-quobyte-ae1648ab-8597-4be8-affd-f222b2c836f9" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:07 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6b7300db-2cc0-49d0-963c-08e3afb64711 tempest-SnapshotsActionsTest-1798027063 None] Acquiring lock "cinder-quobyte-c985049e-d0ce-417e-bcac-7923eb2f2d17" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:07 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6b7300db-2cc0-49d0-963c-08e3afb64711 tempest-SnapshotsActionsTest-1798027063 None] Lock "cinder-quobyte-c985049e-d0ce-417e-bcac-7923eb2f2d17" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:07 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-6b7300db-2cc0-49d0-963c-08e3afb64711 tempest-SnapshotsActionsTest-1798027063 None] Deleting offline snapshot c985049e-d0ce-417e-bcac-7923eb2f2d17 of volume ae1648ab-8597-4be8-affd-f222b2c836f9 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:02:07 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-6b7300db-2cc0-49d0-963c-08e3afb64711 tempest-SnapshotsActionsTest-1798027063 None] snapshot_file for this snap is: volume-ae1648ab-8597-4be8-affd-f222b2c836f9.c985049e-d0ce-417e-bcac-7923eb2f2d17 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:02:07 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c067476-a8d4-4b83-989c-c38a549fb002]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6b7300db-2cc0-49d0-963c-08e3afb64711 tempest-SnapshotsActionsTest-1798027063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.c985049e-d0ce-417e-bcac-7923eb2f2d17 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:08 devstack sudo[93343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.c985049e-d0ce-417e-bcac-7923eb2f2d17 Sep 01 02:02:08 devstack sudo[93343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:08 devstack sudo[93343]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6b7300db-2cc0-49d0-963c-08e3afb64711 tempest-SnapshotsActionsTest-1798027063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.c985049e-d0ce-417e-bcac-7923eb2f2d17" returned: 0 in 0.472s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-6b7300db-2cc0-49d0-963c-08e3afb64711 tempest-SnapshotsActionsTest-1798027063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae1648ab-8597-4be8-affd-f222b2c836f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:02:08 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[42be3977-2b59-408a-ae3e-3abcd19ec1ec]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6b7300db-2cc0-49d0-963c-08e3afb64711 tempest-SnapshotsActionsTest-1798027063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:08 devstack sudo[93351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 Sep 01 02:02:08 devstack sudo[93351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:08 devstack sudo[93351]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6b7300db-2cc0-49d0-963c-08e3afb64711 tempest-SnapshotsActionsTest-1798027063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871" returned: 0 in 0.515s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-6b7300db-2cc0-49d0-963c-08e3afb64711 tempest-SnapshotsActionsTest-1798027063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae1648ab-8597-4be8-affd-f222b2c836f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:02:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6b7300db-2cc0-49d0-963c-08e3afb64711 tempest-SnapshotsActionsTest-1798027063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.c985049e-d0ce-417e-bcac-7923eb2f2d17 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:08 devstack sudo[93356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.c985049e-d0ce-417e-bcac-7923eb2f2d17 Sep 01 02:02:08 devstack sudo[93356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:09 devstack sudo[93356]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6b7300db-2cc0-49d0-963c-08e3afb64711 tempest-SnapshotsActionsTest-1798027063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.c985049e-d0ce-417e-bcac-7923eb2f2d17" returned: 0 in 0.582s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6b7300db-2cc0-49d0-963c-08e3afb64711 tempest-SnapshotsActionsTest-1798027063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.c985049e-d0ce-417e-bcac-7923eb2f2d17 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:09 devstack sudo[93362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.c985049e-d0ce-417e-bcac-7923eb2f2d17 Sep 01 02:02:09 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:09 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6b7300db-2cc0-49d0-963c-08e3afb64711 tempest-SnapshotsActionsTest-1798027063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.c985049e-d0ce-417e-bcac-7923eb2f2d17" returned: 0 in 0.332s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:09 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6b7300db-2cc0-49d0-963c-08e3afb64711 tempest-SnapshotsActionsTest-1798027063 None] Lock "cinder-quobyte-c985049e-d0ce-417e-bcac-7923eb2f2d17" released by "_delete_snapshot" :: held 2.052s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:09 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6b7300db-2cc0-49d0-963c-08e3afb64711 tempest-SnapshotsActionsTest-1798027063 None] Lock "cinder-quobyte-ae1648ab-8597-4be8-affd-f222b2c836f9" released by "delete_snapshot" :: held 2.085s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:09 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-6b7300db-2cc0-49d0-963c-08e3afb64711 tempest-SnapshotsActionsTest-1798027063 None] Created reservations ['37010e76-9c26-4f61-97e8-fe7ae583efd4', '37e31563-d35f-4382-843a-56fc74e25d84', '05e7111a-b237-407a-a36f-f8d33c746015', '9eb5175f-a255-4dd7-9eed-383f71025e26'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:02:10 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-6b7300db-2cc0-49d0-963c-08e3afb64711 tempest-SnapshotsActionsTest-1798027063 None] Delete snapshot completed successfully. Sep 01 02:02:10 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6b7300db-2cc0-49d0-963c-08e3afb64711 tempest-SnapshotsActionsTest-1798027063 None] Lock "cinder-c985049e-d0ce-417e-bcac-7923eb2f2d17-delete_snapshot" released by "delete_snapshot" :: held 2.290s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4b66e07a-621a-424d-ac6a-522c14269218 tempest-SnapshotsActionsTest-1669437024 None] Acquiring lock "cinder-7c092b4d-d2fa-44fc-896c-514ecd38e871-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4b66e07a-621a-424d-ac6a-522c14269218 tempest-SnapshotsActionsTest-1669437024 None] Lock "cinder-7c092b4d-d2fa-44fc-896c-514ecd38e871-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4b66e07a-621a-424d-ac6a-522c14269218 tempest-SnapshotsActionsTest-1669437024 None] Acquiring lock "cinder-quobyte-ae1648ab-8597-4be8-affd-f222b2c836f9" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] Flow 'volume_create_manager' (dd7ef4a6-78dc-40c1-b66d-71c9f28c67f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51873db4-3b0a-433b-9985-ff74b945f6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4b66e07a-621a-424d-ac6a-522c14269218 tempest-SnapshotsActionsTest-1669437024 None] Lock "cinder-quobyte-ae1648ab-8597-4be8-affd-f222b2c836f9" acquired by "delete_snapshot" :: waited 0.066s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4b66e07a-621a-424d-ac6a-522c14269218 tempest-SnapshotsActionsTest-1669437024 None] Acquiring lock "cinder-quobyte-7c092b4d-d2fa-44fc-896c-514ecd38e871" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51873db4-3b0a-433b-9985-ff74b945f6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2075413857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43ff3141-d3b1-414f-ace8-305e050476aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88ef66bd1e6e48129e892198bdf1a44d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:12Z,use_quota=True,user_id='eaaee4cd3d134f4aaf5d0255a5d0e72d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3408a61e-5359-4fa7-95c3-86f793af0667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3408a61e-5359-4fa7-95c3-86f793af0667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d13772d-d2e3-4daf-8575-be95b51162d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d13772d-d2e3-4daf-8575-be95b51162d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43ff3141-d3b1-414f-ace8-305e050476aa', 'volume_name': 'volume-43ff3141-d3b1-414f-ace8-305e050476aa', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eefe279-037f-4772-95e3-e8d781832b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eefe279-037f-4772-95e3-e8d781832b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (142cdce3-63d1-41f9-bb53-e1c18f42630a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:11 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] Volume 43ff3141-d3b1-414f-ace8-305e050476aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43ff3141-d3b1-414f-ace8-305e050476aa', 'volume_size': 1} Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2075413857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43ff3141-d3b1-414f-ace8-305e050476aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88ef66bd1e6e48129e892198bdf1a44d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:12Z,use_quota=True,user_id='eaaee4cd3d134f4aaf5d0255a5d0e72d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] Creating volume 43ff3141-d3b1-414f-ace8-305e050476aa {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:02:11 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-43ff3141-d3b1-414f-ace8-305e050476aa 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4b66e07a-621a-424d-ac6a-522c14269218 tempest-SnapshotsActionsTest-1669437024 None] Lock "cinder-quobyte-7c092b4d-d2fa-44fc-896c-514ecd38e871" acquired by "_delete_snapshot" :: waited 0.099s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-4b66e07a-621a-424d-ac6a-522c14269218 tempest-SnapshotsActionsTest-1669437024 None] Deleting offline snapshot 7c092b4d-d2fa-44fc-896c-514ecd38e871 of volume ae1648ab-8597-4be8-affd-f222b2c836f9 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:02:11 devstack sudo[93366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-43ff3141-d3b1-414f-ace8-305e050476aa 1073741824 Sep 01 02:02:11 devstack sudo[93366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-4b66e07a-621a-424d-ac6a-522c14269218 tempest-SnapshotsActionsTest-1669437024 None] snapshot_file for this snap is: volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efa088c-b0e9-4abb-b084-d6e7783daf2b]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4b66e07a-621a-424d-ac6a-522c14269218 tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:11 devstack sudo[93368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 Sep 01 02:02:11 devstack sudo[93368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:12 devstack sudo[93368]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4b66e07a-621a-424d-ac6a-522c14269218 tempest-SnapshotsActionsTest-1669437024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871" returned: 0 in 0.435s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:12 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-4b66e07a-621a-424d-ac6a-522c14269218 tempest-SnapshotsActionsTest-1669437024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae1648ab-8597-4be8-affd-f222b2c836f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:02:12 devstack sudo[93366]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-43ff3141-d3b1-414f-ace8-305e050476aa 1073741824" returned: 0 in 0.534s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:12 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6834bd-3096-4f88-b73d-2fd2e2953d93]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4b66e07a-621a-424d-ac6a-522c14269218 tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-43ff3141-d3b1-414f-ace8-305e050476aa {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:12 devstack sudo[93378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-43ff3141-d3b1-414f-ace8-305e050476aa Sep 01 02:02:12 devstack sudo[93378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:12 devstack sudo[93377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9 Sep 01 02:02:12 devstack sudo[93377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:12 devstack sudo[93378]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-43ff3141-d3b1-414f-ace8-305e050476aa" returned: 0 in 0.332s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:12 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:02:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (142cdce3-63d1-41f9-bb53-e1c18f42630a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43ff3141-d3b1-414f-ace8-305e050476aa', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abc4a084-fb4a-463a-ac8c-0ee6d9af2fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:12 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] Volume volume-43ff3141-d3b1-414f-ace8-305e050476aa (43ff3141-d3b1-414f-ace8-305e050476aa): created successfully Sep 01 02:02:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abc4a084-fb4a-463a-ac8c-0ee6d9af2fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] Flow 'volume_create_manager' (dd7ef4a6-78dc-40c1-b66d-71c9f28c67f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:12 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-21c49b2c-78e3-4d9c-aa4a-32f032fd9adf tempest-VolumesListAdminTestJSON-1895921852 None] Created volume successfully. Sep 01 02:02:12 devstack sudo[93377]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4b66e07a-621a-424d-ac6a-522c14269218 tempest-SnapshotsActionsTest-1669437024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9" returned: 0 in 0.527s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4b66e07a-621a-424d-ac6a-522c14269218 tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:12 devstack sudo[93385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 Sep 01 02:02:12 devstack sudo[93385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:13 devstack sudo[93385]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4b66e07a-621a-424d-ac6a-522c14269218 tempest-SnapshotsActionsTest-1669437024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871" returned: 0 in 0.429s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4b66e07a-621a-424d-ac6a-522c14269218 tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:13 devstack sudo[93390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871 Sep 01 02:02:13 devstack sudo[93390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:13 devstack sudo[93390]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4b66e07a-621a-424d-ac6a-522c14269218 tempest-SnapshotsActionsTest-1669437024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9.7c092b4d-d2fa-44fc-896c-514ecd38e871" returned: 0 in 0.356s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:13 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4b66e07a-621a-424d-ac6a-522c14269218 tempest-SnapshotsActionsTest-1669437024 None] Lock "cinder-quobyte-7c092b4d-d2fa-44fc-896c-514ecd38e871" released by "_delete_snapshot" :: held 1.897s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:13 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4b66e07a-621a-424d-ac6a-522c14269218 tempest-SnapshotsActionsTest-1669437024 None] Lock "cinder-quobyte-ae1648ab-8597-4be8-affd-f222b2c836f9" released by "delete_snapshot" :: held 2.009s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:13 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-4b66e07a-621a-424d-ac6a-522c14269218 tempest-SnapshotsActionsTest-1669437024 None] Created reservations ['724bd2a6-214d-4ba5-a8ad-c6c31e0dba0b', '0f773254-b907-4930-976a-d22232c097c4', '1e78775d-69ba-47ce-9ae6-01d2c39d1846', '98d34cd9-6684-431b-bc8b-49f489c7aeb2'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:02:13 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-4b66e07a-621a-424d-ac6a-522c14269218 tempest-SnapshotsActionsTest-1669437024 None] Delete snapshot completed successfully. Sep 01 02:02:13 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4b66e07a-621a-424d-ac6a-522c14269218 tempest-SnapshotsActionsTest-1669437024 None] Lock "cinder-7c092b4d-d2fa-44fc-896c-514ecd38e871-delete_snapshot" released by "delete_snapshot" :: held 2.241s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:14 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:02:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] Flow 'volume_create_manager' (7d0f8e26-1449-4bfd-9862-02c6ec7e629d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8363f43f-e7ba-4fa1-bec4-3f235508dbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8363f43f-e7ba-4fa1-bec4-3f235508dbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2102284732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56059163-ed17-4168-8392-0188f1d822e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88ef66bd1e6e48129e892198bdf1a44d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:14Z,use_quota=True,user_id='eaaee4cd3d134f4aaf5d0255a5d0e72d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e17b774-4b83-433b-ae22-a9353b343da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e17b774-4b83-433b-ae22-a9353b343da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d175f0e-28f4-4be0-b753-462be3da65bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d175f0e-28f4-4be0-b753-462be3da65bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56059163-ed17-4168-8392-0188f1d822e7', 'volume_name': 'volume-56059163-ed17-4168-8392-0188f1d822e7', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bbf50a2-ccc8-401b-9269-8844877489ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bbf50a2-ccc8-401b-9269-8844877489ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a00b4d-9cc0-4daa-8d53-7349c9832f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:14 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] Volume 56059163-ed17-4168-8392-0188f1d822e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56059163-ed17-4168-8392-0188f1d822e7', 'volume_size': 1} Sep 01 02:02:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2102284732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56059163-ed17-4168-8392-0188f1d822e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88ef66bd1e6e48129e892198bdf1a44d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:14Z,use_quota=True,user_id='eaaee4cd3d134f4aaf5d0255a5d0e72d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:02:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] Creating volume 56059163-ed17-4168-8392-0188f1d822e7 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:02:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:02:14 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:02:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-56059163-ed17-4168-8392-0188f1d822e7 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:14 devstack sudo[93393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-56059163-ed17-4168-8392-0188f1d822e7 1073741824 Sep 01 02:02:14 devstack sudo[93393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:14 devstack sudo[93393]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-56059163-ed17-4168-8392-0188f1d822e7 1073741824" returned: 0 in 0.549s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:14 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:UPDATE=140,cinder:SELECT=118,cinder:INSERT=37,cinder:DELETE=8 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:02:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-56059163-ed17-4168-8392-0188f1d822e7 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:14 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-665f7b30-4523-4d02-b7bd-7e665880c553 tempest-SnapshotsActionsTest-1669437024 None] Acquiring lock "cinder-ae1648ab-8597-4be8-affd-f222b2c836f9-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:14 devstack sudo[93399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-56059163-ed17-4168-8392-0188f1d822e7 Sep 01 02:02:14 devstack sudo[93399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:14 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-665f7b30-4523-4d02-b7bd-7e665880c553 tempest-SnapshotsActionsTest-1669437024 None] Lock "cinder-ae1648ab-8597-4be8-affd-f222b2c836f9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:15 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-665f7b30-4523-4d02-b7bd-7e665880c553 tempest-SnapshotsActionsTest-1669437024 None] Acquiring lock "cinder-quobyte-ae1648ab-8597-4be8-affd-f222b2c836f9" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:15 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-665f7b30-4523-4d02-b7bd-7e665880c553 tempest-SnapshotsActionsTest-1669437024 None] Lock "cinder-quobyte-ae1648ab-8597-4be8-affd-f222b2c836f9" acquired by "delete_volume" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:15 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46b4b1c-4626-40d5-b3c5-e1c4b7b7a574]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-665f7b30-4523-4d02-b7bd-7e665880c553 tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:15 devstack sudo[93401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9 Sep 01 02:02:15 devstack sudo[93401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:15 devstack sudo[93399]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-56059163-ed17-4168-8392-0188f1d822e7" returned: 0 in 0.387s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:15 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:02:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a00b4d-9cc0-4daa-8d53-7349c9832f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56059163-ed17-4168-8392-0188f1d822e7', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e8a18d3-3384-41a5-9dd3-c8512d49a802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:15 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] Volume volume-56059163-ed17-4168-8392-0188f1d822e7 (56059163-ed17-4168-8392-0188f1d822e7): created successfully Sep 01 02:02:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e8a18d3-3384-41a5-9dd3-c8512d49a802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] Flow 'volume_create_manager' (7d0f8e26-1449-4bfd-9862-02c6ec7e629d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:15 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-f2ff64d1-369f-41b3-92c7-4185a3ee48c3 tempest-VolumesListAdminTestJSON-1895921852 None] Created volume successfully. Sep 01 02:02:15 devstack sudo[93401]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-665f7b30-4523-4d02-b7bd-7e665880c553 tempest-SnapshotsActionsTest-1669437024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9" returned: 0 in 0.473s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-665f7b30-4523-4d02-b7bd-7e665880c553 tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:15 devstack sudo[93407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9 Sep 01 02:02:15 devstack sudo[93407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:15 devstack sudo[93407]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-665f7b30-4523-4d02-b7bd-7e665880c553 tempest-SnapshotsActionsTest-1669437024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae1648ab-8597-4be8-affd-f222b2c836f9" returned: 0 in 0.266s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:15 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-665f7b30-4523-4d02-b7bd-7e665880c553 tempest-SnapshotsActionsTest-1669437024 None] Lock "cinder-quobyte-ae1648ab-8597-4be8-affd-f222b2c836f9" released by "delete_volume" :: held 0.848s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:15 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-665f7b30-4523-4d02-b7bd-7e665880c553 tempest-SnapshotsActionsTest-1669437024 None] Created reservations ['07313f49-b076-44ee-a5b4-811a2abc8573', '8eff4ecc-f406-4291-90b9-453929c97440', '5da10cc0-9897-4897-9225-53dea65658c2', 'faecde63-748c-4577-8ec8-fa60e550cd2a'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:02:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-665f7b30-4523-4d02-b7bd-7e665880c553 tempest-SnapshotsActionsTest-1669437024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-665f7b30-4523-4d02-b7bd-7e665880c553 tempest-SnapshotsActionsTest-1669437024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-665f7b30-4523-4d02-b7bd-7e665880c553 tempest-SnapshotsActionsTest-1669437024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-665f7b30-4523-4d02-b7bd-7e665880c553 tempest-SnapshotsActionsTest-1669437024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-665f7b30-4523-4d02-b7bd-7e665880c553 tempest-SnapshotsActionsTest-1669437024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-665f7b30-4523-4d02-b7bd-7e665880c553 tempest-SnapshotsActionsTest-1669437024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:16 devstack sudo[93410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:02:16 devstack sudo[93410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:16 devstack sudo[93410]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-665f7b30-4523-4d02-b7bd-7e665880c553 tempest-SnapshotsActionsTest-1669437024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.496s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:16 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-665f7b30-4523-4d02-b7bd-7e665880c553 tempest-SnapshotsActionsTest-1669437024 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:02:16 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-665f7b30-4523-4d02-b7bd-7e665880c553 tempest-SnapshotsActionsTest-1669437024 None] Deleted volume successfully. Sep 01 02:02:16 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-665f7b30-4523-4d02-b7bd-7e665880c553 tempest-SnapshotsActionsTest-1669437024 None] Lock "cinder-ae1648ab-8597-4be8-affd-f222b2c836f9-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:16 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:02:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:17 devstack sudo[93447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:02:17 devstack sudo[93447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:17 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:02:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] Flow 'volume_create_manager' (bbe595e8-bcde-4a9b-9cea-59786c7870b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b5927c7-7706-4b6d-85c4-9f28b7c86cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:17 devstack sudo[93447]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b5927c7-7706-4b6d-85c4-9f28b7c86cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1676549448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e343a5e-613e-4182-b631-d3deecdcbeb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88ef66bd1e6e48129e892198bdf1a44d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:17Z,use_quota=True,user_id='eaaee4cd3d134f4aaf5d0255a5d0e72d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7555ce21-37c3-491f-9f66-ec239c7ee199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7555ce21-37c3-491f-9f66-ec239c7ee199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08bab153-1eeb-4262-9bd3-4c4984ed97d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08bab153-1eeb-4262-9bd3-4c4984ed97d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e343a5e-613e-4182-b631-d3deecdcbeb0', 'volume_name': 'volume-6e343a5e-613e-4182-b631-d3deecdcbeb0', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d42624-389c-4b83-8681-0f3bf24ca0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d42624-389c-4b83-8681-0f3bf24ca0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a12b093f-6afe-4e40-a0bf-f3e2690ecd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:17 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] Volume 6e343a5e-613e-4182-b631-d3deecdcbeb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e343a5e-613e-4182-b631-d3deecdcbeb0', 'volume_size': 1} Sep 01 02:02:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1676549448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e343a5e-613e-4182-b631-d3deecdcbeb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88ef66bd1e6e48129e892198bdf1a44d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:17Z,use_quota=True,user_id='eaaee4cd3d134f4aaf5d0255a5d0e72d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:02:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] Creating volume 6e343a5e-613e-4182-b631-d3deecdcbeb0 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:02:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:02:17 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:02:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6e343a5e-613e-4182-b631-d3deecdcbeb0 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.649s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:17 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:02:17 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager._thread_info {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:02:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread count: 28 {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:02:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread info: [<_MainThread(MainThread, started 128688016527488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:02:17 devstack sudo[93455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6e343a5e-613e-4182-b631-d3deecdcbeb0 1073741824 Sep 01 02:02:17 devstack sudo[93455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:18 devstack sudo[93455]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6e343a5e-613e-4182-b631-d3deecdcbeb0 1073741824" returned: 0 in 0.664s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6e343a5e-613e-4182-b631-d3deecdcbeb0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:18 devstack sudo[93460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6e343a5e-613e-4182-b631-d3deecdcbeb0 Sep 01 02:02:18 devstack sudo[93460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:18 devstack sudo[93460]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6e343a5e-613e-4182-b631-d3deecdcbeb0" returned: 0 in 0.517s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:02:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a12b093f-6afe-4e40-a0bf-f3e2690ecd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e343a5e-613e-4182-b631-d3deecdcbeb0', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c080e543-e6f4-4e71-b145-52c37d63c358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:18 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] Volume volume-6e343a5e-613e-4182-b631-d3deecdcbeb0 (6e343a5e-613e-4182-b631-d3deecdcbeb0): created successfully Sep 01 02:02:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c080e543-e6f4-4e71-b145-52c37d63c358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] Flow 'volume_create_manager' (bbe595e8-bcde-4a9b-9cea-59786c7870b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:18 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-0fc82d03-faf0-4a03-876b-476cddc7ed6f tempest-VolumesListAdminTestJSON-1895921852 None] Created volume successfully. Sep 01 02:02:20 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:02:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] Flow 'volume_create_manager' (2d4903db-e6f1-49b5-af39-c8965ddccce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4871dafc-4210-4eef-a87e-20fa56c04f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4871dafc-4210-4eef-a87e-20fa56c04f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c4363d-9023-4e4f-8a16-e419ba69e0ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1714e6b1632846ad92fbb4b98c79e2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:21Z,use_quota=True,user_id='dacbb1691a314e70826832f9cf856da7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c00013-00df-4d28-b07b-a9ef652fe7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c00013-00df-4d28-b07b-a9ef652fe7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a17af90-9038-4cec-aa06-f6fb562890e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a17af90-9038-4cec-aa06-f6fb562890e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8c4363d-9023-4e4f-8a16-e419ba69e0ec', 'volume_name': 'volume-c8c4363d-9023-4e4f-8a16-e419ba69e0ec', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e92d3eab-01ab-45a3-b038-249fe4137059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e92d3eab-01ab-45a3-b038-249fe4137059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5baae2c2-9f61-4b30-9969-010441730c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:20 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] Volume c8c4363d-9023-4e4f-8a16-e419ba69e0ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8c4363d-9023-4e4f-8a16-e419ba69e0ec', 'volume_size': 1} Sep 01 02:02:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:20 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c4363d-9023-4e4f-8a16-e419ba69e0ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1714e6b1632846ad92fbb4b98c79e2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:21Z,use_quota=True,user_id='dacbb1691a314e70826832f9cf856da7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:02:20 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] Creating volume c8c4363d-9023-4e4f-8a16-e419ba69e0ec {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:02:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:20 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:20 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:20 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:02:20 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:02:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c8c4363d-9023-4e4f-8a16-e419ba69e0ec 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:20 devstack sudo[93471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c8c4363d-9023-4e4f-8a16-e419ba69e0ec 1073741824 Sep 01 02:02:20 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:21 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c8c4363d-9023-4e4f-8a16-e419ba69e0ec 1073741824" returned: 0 in 0.589s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c8c4363d-9023-4e4f-8a16-e419ba69e0ec {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:21 devstack sudo[93488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c8c4363d-9023-4e4f-8a16-e419ba69e0ec Sep 01 02:02:21 devstack sudo[93488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:21 devstack sudo[93488]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c8c4363d-9023-4e4f-8a16-e419ba69e0ec" returned: 0 in 0.323s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:02:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5baae2c2-9f61-4b30-9969-010441730c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8c4363d-9023-4e4f-8a16-e419ba69e0ec', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (154a55dd-d6c2-40de-8086-baa0d5551b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:21 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] Volume volume-c8c4363d-9023-4e4f-8a16-e419ba69e0ec (c8c4363d-9023-4e4f-8a16-e419ba69e0ec): created successfully Sep 01 02:02:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (154a55dd-d6c2-40de-8086-baa0d5551b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] Flow 'volume_create_manager' (2d4903db-e6f1-49b5-af39-c8965ddccce0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:21 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-98b9f6ee-ecbf-4092-b376-dc738fb4b28c tempest-VolumesListAdminTestJSON-580886498 None] Created volume successfully. Sep 01 02:02:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-733a3d42-adab-4d28-97e9-b2fcfeaba684 tempest-VolumesListAdminTestJSON-580886498 None] Acquiring lock "cinder-c8c4363d-9023-4e4f-8a16-e419ba69e0ec-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-733a3d42-adab-4d28-97e9-b2fcfeaba684 tempest-VolumesListAdminTestJSON-580886498 None] Lock "cinder-c8c4363d-9023-4e4f-8a16-e419ba69e0ec-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-733a3d42-adab-4d28-97e9-b2fcfeaba684 tempest-VolumesListAdminTestJSON-580886498 None] Acquiring lock "cinder-quobyte-c8c4363d-9023-4e4f-8a16-e419ba69e0ec" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-733a3d42-adab-4d28-97e9-b2fcfeaba684 tempest-VolumesListAdminTestJSON-580886498 None] Lock "cinder-quobyte-c8c4363d-9023-4e4f-8a16-e419ba69e0ec" acquired by "delete_volume" :: waited 0.032s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:23 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d54664-684c-4614-89e2-edf47d2e8316]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-733a3d42-adab-4d28-97e9-b2fcfeaba684 tempest-VolumesListAdminTestJSON-580886498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c8c4363d-9023-4e4f-8a16-e419ba69e0ec {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2fffc3b4-12f2-4345-b00e-76914bc530f0 tempest-VolumesListAdminTestJSON-1895921852 None] Acquiring lock "cinder-6e343a5e-613e-4182-b631-d3deecdcbeb0-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2fffc3b4-12f2-4345-b00e-76914bc530f0 tempest-VolumesListAdminTestJSON-1895921852 None] Lock "cinder-6e343a5e-613e-4182-b631-d3deecdcbeb0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2fffc3b4-12f2-4345-b00e-76914bc530f0 tempest-VolumesListAdminTestJSON-1895921852 None] Acquiring lock "cinder-quobyte-6e343a5e-613e-4182-b631-d3deecdcbeb0" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2fffc3b4-12f2-4345-b00e-76914bc530f0 tempest-VolumesListAdminTestJSON-1895921852 None] Lock "cinder-quobyte-6e343a5e-613e-4182-b631-d3deecdcbeb0" acquired by "delete_volume" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:23 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e92b951-6050-4bae-b8d9-667e6156b837]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2fffc3b4-12f2-4345-b00e-76914bc530f0 tempest-VolumesListAdminTestJSON-1895921852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6e343a5e-613e-4182-b631-d3deecdcbeb0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:23 devstack sudo[93492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c8c4363d-9023-4e4f-8a16-e419ba69e0ec Sep 01 02:02:23 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:23 devstack sudo[93493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6e343a5e-613e-4182-b631-d3deecdcbeb0 Sep 01 02:02:23 devstack sudo[93493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:23 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-733a3d42-adab-4d28-97e9-b2fcfeaba684 tempest-VolumesListAdminTestJSON-580886498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c8c4363d-9023-4e4f-8a16-e419ba69e0ec" returned: 0 in 0.477s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-733a3d42-adab-4d28-97e9-b2fcfeaba684 tempest-VolumesListAdminTestJSON-580886498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c8c4363d-9023-4e4f-8a16-e419ba69e0ec {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:24 devstack sudo[93499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c8c4363d-9023-4e4f-8a16-e419ba69e0ec Sep 01 02:02:24 devstack sudo[93499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:24 devstack sudo[93493]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2fffc3b4-12f2-4345-b00e-76914bc530f0 tempest-VolumesListAdminTestJSON-1895921852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6e343a5e-613e-4182-b631-d3deecdcbeb0" returned: 0 in 0.495s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2fffc3b4-12f2-4345-b00e-76914bc530f0 tempest-VolumesListAdminTestJSON-1895921852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6e343a5e-613e-4182-b631-d3deecdcbeb0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:24 devstack sudo[93504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6e343a5e-613e-4182-b631-d3deecdcbeb0 Sep 01 02:02:24 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:24 devstack sudo[93499]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-733a3d42-adab-4d28-97e9-b2fcfeaba684 tempest-VolumesListAdminTestJSON-580886498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c8c4363d-9023-4e4f-8a16-e419ba69e0ec" returned: 0 in 0.400s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-733a3d42-adab-4d28-97e9-b2fcfeaba684 tempest-VolumesListAdminTestJSON-580886498 None] Lock "cinder-quobyte-c8c4363d-9023-4e4f-8a16-e419ba69e0ec" released by "delete_volume" :: held 0.962s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:24 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-733a3d42-adab-4d28-97e9-b2fcfeaba684 tempest-VolumesListAdminTestJSON-580886498 None] Created reservations ['12b1772c-4146-43a4-8126-2870a6ff6bd5', 'a513b376-3723-4712-b36f-b6d8fb1cdfb3', 'e01f70a5-221a-4f4f-85ff-77270e846dcf', '2614f768-4086-494e-91b3-715aebf2e73d'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:02:24 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2fffc3b4-12f2-4345-b00e-76914bc530f0 tempest-VolumesListAdminTestJSON-1895921852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6e343a5e-613e-4182-b631-d3deecdcbeb0" returned: 0 in 0.376s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2fffc3b4-12f2-4345-b00e-76914bc530f0 tempest-VolumesListAdminTestJSON-1895921852 None] Lock "cinder-quobyte-6e343a5e-613e-4182-b631-d3deecdcbeb0" released by "delete_volume" :: held 0.947s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-733a3d42-adab-4d28-97e9-b2fcfeaba684 tempest-VolumesListAdminTestJSON-580886498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-733a3d42-adab-4d28-97e9-b2fcfeaba684 tempest-VolumesListAdminTestJSON-580886498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:24 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-733a3d42-adab-4d28-97e9-b2fcfeaba684 tempest-VolumesListAdminTestJSON-580886498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:24 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-733a3d42-adab-4d28-97e9-b2fcfeaba684 tempest-VolumesListAdminTestJSON-580886498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-733a3d42-adab-4d28-97e9-b2fcfeaba684 tempest-VolumesListAdminTestJSON-580886498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-733a3d42-adab-4d28-97e9-b2fcfeaba684 tempest-VolumesListAdminTestJSON-580886498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:24 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-2fffc3b4-12f2-4345-b00e-76914bc530f0 tempest-VolumesListAdminTestJSON-1895921852 None] Created reservations ['06977bce-265d-4901-a45c-8dac7bcd6698', 'c4d88ed2-7711-4c89-a016-6366d04a5677', '2cbd13a9-800e-4627-bf27-1b2d0bc3c0c0', '5d9f9565-a215-4b76-8f34-f8d582354694'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:02:24 devstack sudo[93509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:02:24 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2fffc3b4-12f2-4345-b00e-76914bc530f0 tempest-VolumesListAdminTestJSON-1895921852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2fffc3b4-12f2-4345-b00e-76914bc530f0 tempest-VolumesListAdminTestJSON-1895921852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:24 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2fffc3b4-12f2-4345-b00e-76914bc530f0 tempest-VolumesListAdminTestJSON-1895921852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:24 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2fffc3b4-12f2-4345-b00e-76914bc530f0 tempest-VolumesListAdminTestJSON-1895921852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2fffc3b4-12f2-4345-b00e-76914bc530f0 tempest-VolumesListAdminTestJSON-1895921852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2fffc3b4-12f2-4345-b00e-76914bc530f0 tempest-VolumesListAdminTestJSON-1895921852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:24 devstack sudo[93511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:02:24 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:25 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-733a3d42-adab-4d28-97e9-b2fcfeaba684 tempest-VolumesListAdminTestJSON-580886498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.443s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:25 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-733a3d42-adab-4d28-97e9-b2fcfeaba684 tempest-VolumesListAdminTestJSON-580886498 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:02:25 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-733a3d42-adab-4d28-97e9-b2fcfeaba684 tempest-VolumesListAdminTestJSON-580886498 None] Deleted volume successfully. Sep 01 02:02:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-733a3d42-adab-4d28-97e9-b2fcfeaba684 tempest-VolumesListAdminTestJSON-580886498 None] Lock "cinder-c8c4363d-9023-4e4f-8a16-e419ba69e0ec-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:25 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2fffc3b4-12f2-4345-b00e-76914bc530f0 tempest-VolumesListAdminTestJSON-1895921852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.461s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:25 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-2fffc3b4-12f2-4345-b00e-76914bc530f0 tempest-VolumesListAdminTestJSON-1895921852 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:02:25 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-2fffc3b4-12f2-4345-b00e-76914bc530f0 tempest-VolumesListAdminTestJSON-1895921852 None] Deleted volume successfully. Sep 01 02:02:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2fffc3b4-12f2-4345-b00e-76914bc530f0 tempest-VolumesListAdminTestJSON-1895921852 None] Lock "cinder-6e343a5e-613e-4182-b631-d3deecdcbeb0-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:26 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fb9f1390-b382-4f4f-aa17-8757e5ec693a tempest-VolumesListAdminTestJSON-1895921852 None] Acquiring lock "cinder-56059163-ed17-4168-8392-0188f1d822e7-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:26 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fb9f1390-b382-4f4f-aa17-8757e5ec693a tempest-VolumesListAdminTestJSON-1895921852 None] Lock "cinder-56059163-ed17-4168-8392-0188f1d822e7-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:26 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fb9f1390-b382-4f4f-aa17-8757e5ec693a tempest-VolumesListAdminTestJSON-1895921852 None] Acquiring lock "cinder-quobyte-56059163-ed17-4168-8392-0188f1d822e7" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:26 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fb9f1390-b382-4f4f-aa17-8757e5ec693a tempest-VolumesListAdminTestJSON-1895921852 None] Lock "cinder-quobyte-56059163-ed17-4168-8392-0188f1d822e7" acquired by "delete_volume" :: waited 0.032s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:26 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a3845f-c4b9-4896-9690-c3a8143fd9b6]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fb9f1390-b382-4f4f-aa17-8757e5ec693a tempest-VolumesListAdminTestJSON-1895921852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-56059163-ed17-4168-8392-0188f1d822e7 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:26 devstack sudo[93588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-56059163-ed17-4168-8392-0188f1d822e7 Sep 01 02:02:26 devstack sudo[93588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:27 devstack sudo[93588]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fb9f1390-b382-4f4f-aa17-8757e5ec693a tempest-VolumesListAdminTestJSON-1895921852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-56059163-ed17-4168-8392-0188f1d822e7" returned: 0 in 0.850s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fb9f1390-b382-4f4f-aa17-8757e5ec693a tempest-VolumesListAdminTestJSON-1895921852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-56059163-ed17-4168-8392-0188f1d822e7 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:27 devstack sudo[93598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-56059163-ed17-4168-8392-0188f1d822e7 Sep 01 02:02:27 devstack sudo[93598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:27 devstack sudo[93598]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fb9f1390-b382-4f4f-aa17-8757e5ec693a tempest-VolumesListAdminTestJSON-1895921852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-56059163-ed17-4168-8392-0188f1d822e7" returned: 0 in 0.355s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:27 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fb9f1390-b382-4f4f-aa17-8757e5ec693a tempest-VolumesListAdminTestJSON-1895921852 None] Lock "cinder-quobyte-56059163-ed17-4168-8392-0188f1d822e7" released by "delete_volume" :: held 1.279s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:27 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-fb9f1390-b382-4f4f-aa17-8757e5ec693a tempest-VolumesListAdminTestJSON-1895921852 None] Created reservations ['aeec987f-8942-4150-9818-2f72c0165d91', '63e416fc-cb18-4037-b2ff-d838a0a9129a', 'a62d9a19-1f16-45d1-832d-de56efab6400', '1acfa0c3-9ca5-4ce1-8146-7e29f154f505'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:02:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fb9f1390-b382-4f4f-aa17-8757e5ec693a tempest-VolumesListAdminTestJSON-1895921852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fb9f1390-b382-4f4f-aa17-8757e5ec693a tempest-VolumesListAdminTestJSON-1895921852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fb9f1390-b382-4f4f-aa17-8757e5ec693a tempest-VolumesListAdminTestJSON-1895921852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fb9f1390-b382-4f4f-aa17-8757e5ec693a tempest-VolumesListAdminTestJSON-1895921852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fb9f1390-b382-4f4f-aa17-8757e5ec693a tempest-VolumesListAdminTestJSON-1895921852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fb9f1390-b382-4f4f-aa17-8757e5ec693a tempest-VolumesListAdminTestJSON-1895921852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:27 devstack sudo[93603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:02:27 devstack sudo[93603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:28 devstack sudo[93603]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fb9f1390-b382-4f4f-aa17-8757e5ec693a tempest-VolumesListAdminTestJSON-1895921852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.704s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:28 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-fb9f1390-b382-4f4f-aa17-8757e5ec693a tempest-VolumesListAdminTestJSON-1895921852 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:02:28 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-fb9f1390-b382-4f4f-aa17-8757e5ec693a tempest-VolumesListAdminTestJSON-1895921852 None] Deleted volume successfully. Sep 01 02:02:28 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fb9f1390-b382-4f4f-aa17-8757e5ec693a tempest-VolumesListAdminTestJSON-1895921852 None] Lock "cinder-56059163-ed17-4168-8392-0188f1d822e7-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:28 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-132baff9-1e59-4aed-8eba-7d16a6b24784 tempest-VolumesListAdminTestJSON-1895921852 None] Acquiring lock "cinder-43ff3141-d3b1-414f-ace8-305e050476aa-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:28 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-132baff9-1e59-4aed-8eba-7d16a6b24784 tempest-VolumesListAdminTestJSON-1895921852 None] Lock "cinder-43ff3141-d3b1-414f-ace8-305e050476aa-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:28 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-132baff9-1e59-4aed-8eba-7d16a6b24784 tempest-VolumesListAdminTestJSON-1895921852 None] Acquiring lock "cinder-quobyte-43ff3141-d3b1-414f-ace8-305e050476aa" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:28 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-132baff9-1e59-4aed-8eba-7d16a6b24784 tempest-VolumesListAdminTestJSON-1895921852 None] Lock "cinder-quobyte-43ff3141-d3b1-414f-ace8-305e050476aa" acquired by "delete_volume" :: waited 0.026s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:28 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[07885ebb-f371-44ef-bd7a-0af23741e782]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-132baff9-1e59-4aed-8eba-7d16a6b24784 tempest-VolumesListAdminTestJSON-1895921852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-43ff3141-d3b1-414f-ace8-305e050476aa {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:29 devstack sudo[93613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-43ff3141-d3b1-414f-ace8-305e050476aa Sep 01 02:02:29 devstack sudo[93613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:29 devstack sudo[93613]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-132baff9-1e59-4aed-8eba-7d16a6b24784 tempest-VolumesListAdminTestJSON-1895921852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-43ff3141-d3b1-414f-ace8-305e050476aa" returned: 0 in 0.789s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-132baff9-1e59-4aed-8eba-7d16a6b24784 tempest-VolumesListAdminTestJSON-1895921852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-43ff3141-d3b1-414f-ace8-305e050476aa {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:29 devstack sudo[93630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-43ff3141-d3b1-414f-ace8-305e050476aa Sep 01 02:02:29 devstack sudo[93630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:30 devstack sudo[93630]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-132baff9-1e59-4aed-8eba-7d16a6b24784 tempest-VolumesListAdminTestJSON-1895921852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-43ff3141-d3b1-414f-ace8-305e050476aa" returned: 0 in 0.441s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:30 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-132baff9-1e59-4aed-8eba-7d16a6b24784 tempest-VolumesListAdminTestJSON-1895921852 None] Lock "cinder-quobyte-43ff3141-d3b1-414f-ace8-305e050476aa" released by "delete_volume" :: held 1.343s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:30 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-132baff9-1e59-4aed-8eba-7d16a6b24784 tempest-VolumesListAdminTestJSON-1895921852 None] Created reservations ['6f472e7f-8a48-4c56-8823-47960019631a', '926ed5c5-e44f-4cc1-ac63-6617bdd2311b', '3a12a876-811c-4fc7-9f24-6b4bd97e2116', '4194a2da-a802-48d9-bdb8-23c5277b9f21'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:02:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-132baff9-1e59-4aed-8eba-7d16a6b24784 tempest-VolumesListAdminTestJSON-1895921852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-132baff9-1e59-4aed-8eba-7d16a6b24784 tempest-VolumesListAdminTestJSON-1895921852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-132baff9-1e59-4aed-8eba-7d16a6b24784 tempest-VolumesListAdminTestJSON-1895921852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-132baff9-1e59-4aed-8eba-7d16a6b24784 tempest-VolumesListAdminTestJSON-1895921852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-132baff9-1e59-4aed-8eba-7d16a6b24784 tempest-VolumesListAdminTestJSON-1895921852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-132baff9-1e59-4aed-8eba-7d16a6b24784 tempest-VolumesListAdminTestJSON-1895921852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:30 devstack sudo[93633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:02:30 devstack sudo[93633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:30 devstack sudo[93633]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-132baff9-1e59-4aed-8eba-7d16a6b24784 tempest-VolumesListAdminTestJSON-1895921852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.273s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:30 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-132baff9-1e59-4aed-8eba-7d16a6b24784 tempest-VolumesListAdminTestJSON-1895921852 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:02:30 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-132baff9-1e59-4aed-8eba-7d16a6b24784 tempest-VolumesListAdminTestJSON-1895921852 None] Deleted volume successfully. Sep 01 02:02:30 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-132baff9-1e59-4aed-8eba-7d16a6b24784 tempest-VolumesListAdminTestJSON-1895921852 None] Lock "cinder-43ff3141-d3b1-414f-ace8-305e050476aa-delete_volume" released by "delete_volume" :: held 2.127s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Flow 'volume_create_manager' (1d7f7e92-d75b-4f46-8879-19c12f01723f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9668a76-7c01-4134-b7ae-6bf584da1dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9668a76-7c01-4134-b7ae-6bf584da1dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-8778893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ce2e46f-651b-4ab3-b5fd-fc5cab85f796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9478b59d167c42bf9df224a37e571e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:43Z,use_quota=True,user_id='1dd9e236b4d74540a7ea9216846a8996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b22e66c7-f3a0-4f05-9cab-20da20a46900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b22e66c7-f3a0-4f05-9cab-20da20a46900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a096594f-a312-4ab9-bbff-387ad282a400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG cinder.image.glance [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Creating Keystone auth plugin from conf {{(pid=87128) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a096594f-a312-4ab9-bbff-387ad282a400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5ce2e46f-651b-4ab3-b5fd-fc5cab85f796', 'volume_name': 'volume-5ce2e46f-651b-4ab3-b5fd-fc5cab85f796', 'volume_size': 1, 'image_id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64fc298b-4656-41e6-a52e-bd149cb491e9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0dbd8f0a33a74d5db3271102e89b70d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'created_at': datetime.datetime(2026, 8, 31, 23, 51, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 51, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64fc298b-4656-41e6-a52e-bd149cb491e9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffaf572d-731b-4a51-800e-fd35eedb9ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffaf572d-731b-4a51-800e-fd35eedb9ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61307fa4-38bf-40db-8f18-2db7c425fc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:43 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Volume 5ce2e46f-651b-4ab3-b5fd-fc5cab85f796: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5ce2e46f-651b-4ab3-b5fd-fc5cab85f796', 'volume_size': 1, 'image_id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64fc298b-4656-41e6-a52e-bd149cb491e9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0dbd8f0a33a74d5db3271102e89b70d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'created_at': datetime.datetime(2026, 8, 31, 23, 51, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 51, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64fc298b-4656-41e6-a52e-bd149cb491e9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Trying to clone 5ce2e46f-651b-4ab3-b5fd-fc5cab85f796 from image 64fc298b-4656-41e6-a52e-bd149cb491e9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/64fc298b-4656-41e6-a52e-bd149cb491e9', 'metadata': {}}]). {{(pid=87128) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Flow 'volume_create_manager' (fe4932bb-5e15-40c2-ac38-d3d503cc23dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5aa1c6-64e0-4889-ad94-4dc5b2627da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5aa1c6-64e0-4889-ad94-4dc5b2627da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1504439522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02c0a6cb-b232-4e98-98bb-867d5a8f597d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f576b247b5ec4baba7c2525789b89999',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:44Z,use_quota=True,user_id='0654f1a12c264f6289126774440daa8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe4bfd1-ab35-4dbd-b5db-719cf4471836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe4bfd1-ab35-4dbd-b5db-719cf4471836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dbba369-b53b-4058-a55a-eb0a33eed6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dbba369-b53b-4058-a55a-eb0a33eed6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02c0a6cb-b232-4e98-98bb-867d5a8f597d', 'volume_name': 'volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a801a58d-8353-410f-82c7-45fc9239ae2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a801a58d-8353-410f-82c7-45fc9239ae2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff32f0a-40ed-4ec7-956d-87159223f514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:43 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Volume 02c0a6cb-b232-4e98-98bb-867d5a8f597d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d', 'volume_size': 1} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1504439522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02c0a6cb-b232-4e98-98bb-867d5a8f597d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f576b247b5ec4baba7c2525789b89999',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:44Z,use_quota=True,user_id='0654f1a12c264f6289126774440daa8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Creating volume 02c0a6cb-b232-4e98-98bb-867d5a8f597d {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:02:43 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:02:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:43 devstack sudo[93751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d 1073741824 Sep 01 02:02:43 devstack sudo[93751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:44 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_38yr277sdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87128) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:02:44 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Image download 20.69 MB at 20.69 MB/s Sep 01 02:02:44 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e264321-024a-475c-93ba-43505aa652fa]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_38yr277sdevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:44 devstack sudo[93757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_38yr277sdevstack@QuobyteHD Sep 01 02:02:44 devstack sudo[93757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:44 devstack sudo[93751]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d 1073741824" returned: 0 in 0.516s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:44 devstack sudo[93759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d Sep 01 02:02:44 devstack sudo[93759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:44 devstack sudo[93757]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_38yr277sdevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:44 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Temporary image 64fc298b-4656-41e6-a52e-bd149cb491e9 is fetched for user 1dd9e236b4d74540a7ea9216846a8996. {{(pid=87128) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:02:44 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bc5a55-6731-4998-a6e4-016be7ad92a3]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_38yr277sdevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:44 devstack sudo[93759]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d" returned: 0 in 0.252s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:44 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:02:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff32f0a-40ed-4ec7-956d-87159223f514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a621343-8e96-499a-bbd5-c80c94a927b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:44 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Volume volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d (02c0a6cb-b232-4e98-98bb-867d5a8f597d): created successfully Sep 01 02:02:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a621343-8e96-499a-bbd5-c80c94a927b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Flow 'volume_create_manager' (fe4932bb-5e15-40c2-ac38-d3d503cc23dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:44 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-ed24c60e-2d26-4f27-b6b0-299c043fc8e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Created volume successfully. Sep 01 02:02:44 devstack sudo[93765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_38yr277sdevstack@QuobyteHD Sep 01 02:02:44 devstack sudo[93765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:44 devstack sudo[93765]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_38yr277sdevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:44 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-8778893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ce2e46f-651b-4ab3-b5fd-fc5cab85f796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9478b59d167c42bf9df224a37e571e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:43Z,use_quota=True,user_id='1dd9e236b4d74540a7ea9216846a8996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:02:44 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Creating volume 5ce2e46f-651b-4ab3-b5fd-fc5cab85f796 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:02:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:44 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:44 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:44 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:02:44 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:02:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5ce2e46f-651b-4ab3-b5fd-fc5cab85f796 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:44 devstack sudo[93770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5ce2e46f-651b-4ab3-b5fd-fc5cab85f796 1073741824 Sep 01 02:02:44 devstack sudo[93770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:45 devstack sudo[93770]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5ce2e46f-651b-4ab3-b5fd-fc5cab85f796 1073741824" returned: 0 in 0.432s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5ce2e46f-651b-4ab3-b5fd-fc5cab85f796 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:45 devstack sudo[93775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5ce2e46f-651b-4ab3-b5fd-fc5cab85f796 Sep 01 02:02:45 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:45 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5ce2e46f-651b-4ab3-b5fd-fc5cab85f796" returned: 0 in 0.240s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:45 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:02:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:45 devstack cinder-volume[87128]: DEBUG cinder.volume.volume_utils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Attempting download of 64fc298b-4656-41e6-a52e-bd149cb491e9 ((None, [{'url': 'file:///opt/stack/data/glance/images/64fc298b-4656-41e6-a52e-bd149cb491e9', 'metadata': {}}])) to volume 5ce2e46f-651b-4ab3-b5fd-fc5cab85f796. {{(pid=87128) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:02:45 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[138b7ae0-4f48-4b19-aad8-08cc5e6eee90]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_snb6kmwg {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:45 devstack sudo[93778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_snb6kmwg Sep 01 02:02:45 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d0edc6bb-094c-4dd2-8596-bc953691baad tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d0edc6bb-094c-4dd2-8596-bc953691baad tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-d0edc6bb-094c-4dd2-8596-bc953691baad tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Creating offline snapshot 4075fdb8-eace-4d9d-a4a2-6e6c5831aa95 of volume 02c0a6cb-b232-4e98-98bb-867d5a8f597d {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:02:46 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ceff0b9-a93f-4ab5-adc2-60af3c717a0c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d0edc6bb-094c-4dd2-8596-bc953691baad tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:46 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_snb6kmwg" returned: 0 in 0.396s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_snb6kmwg {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:46 devstack sudo[93780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d Sep 01 02:02:46 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:46 devstack sudo[93783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_snb6kmwg Sep 01 02:02:46 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:46 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d0edc6bb-094c-4dd2-8596-bc953691baad tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d" returned: 0 in 0.358s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d0edc6bb-094c-4dd2-8596-bc953691baad tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d.4075fdb8-eace-4d9d-a4a2-6e6c5831aa95 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:46 devstack sudo[93791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d.4075fdb8-eace-4d9d-a4a2-6e6c5831aa95 1G Sep 01 02:02:46 devstack sudo[93791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:46 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_snb6kmwg" returned: 1 in 0.342s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_snb6kmwg' failed. Not Retrying. {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:02:46 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[19368594-1045-4b85-8d59-847f6be612cc]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_38yr277sdevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:46 devstack sudo[93793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_38yr277sdevstack@QuobyteHD Sep 01 02:02:46 devstack sudo[93793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:46 devstack sudo[93791]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d0edc6bb-094c-4dd2-8596-bc953691baad tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d.4075fdb8-eace-4d9d-a4a2-6e6c5831aa95 1G" returned: 0 in 0.409s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:46 devstack sudo[93793]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d0edc6bb-094c-4dd2-8596-bc953691baad tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d.4075fdb8-eace-4d9d-a4a2-6e6c5831aa95 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_38yr277sdevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:46 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] 64fc298b-4656-41e6-a52e-bd149cb491e9 was qcow2, converting to qcow2 {{(pid=87128) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:02:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_38yr277sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5ce2e46f-651b-4ab3-b5fd-fc5cab85f796 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:46 devstack sudo[93801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d.4075fdb8-eace-4d9d-a4a2-6e6c5831aa95 Sep 01 02:02:46 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:46 devstack sudo[93802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_38yr277sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5ce2e46f-651b-4ab3-b5fd-fc5cab85f796 Sep 01 02:02:46 devstack sudo[93802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:47 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d0edc6bb-094c-4dd2-8596-bc953691baad tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d.4075fdb8-eace-4d9d-a4a2-6e6c5831aa95" returned: 0 in 0.327s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:47 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-d0edc6bb-094c-4dd2-8596-bc953691baad tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d.4075fdb8-eace-4d9d-a4a2-6e6c5831aa95 is being set with open permissions: ugo+rw Sep 01 02:02:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d0edc6bb-094c-4dd2-8596-bc953691baad tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d.4075fdb8-eace-4d9d-a4a2-6e6c5831aa95 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:47 devstack sudo[93812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d.4075fdb8-eace-4d9d-a4a2-6e6c5831aa95 Sep 01 02:02:47 devstack sudo[93812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:47 devstack sudo[93812]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d0edc6bb-094c-4dd2-8596-bc953691baad tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d.4075fdb8-eace-4d9d-a4a2-6e6c5831aa95" returned: 0 in 0.321s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d0edc6bb-094c-4dd2-8596-bc953691baad tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:47 devstack sudo[93825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d.info Sep 01 02:02:47 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:47 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d0edc6bb-094c-4dd2-8596-bc953691baad tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d.info" returned: 0 in 0.306s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:47 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-d0edc6bb-094c-4dd2-8596-bc953691baad tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d.info is being set with open permissions: ugo+rw Sep 01 02:02:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d0edc6bb-094c-4dd2-8596-bc953691baad tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:47 devstack sudo[93828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d.info Sep 01 02:02:47 devstack sudo[93828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:48 devstack sudo[93828]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d0edc6bb-094c-4dd2-8596-bc953691baad tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d.info" returned: 0 in 0.339s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d0edc6bb-094c-4dd2-8596-bc953691baad tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.175s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:48 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-d0edc6bb-094c-4dd2-8596-bc953691baad tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Create snapshot completed successfully Sep 01 02:02:48 devstack sudo[93802]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_38yr277sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5ce2e46f-651b-4ab3-b5fd-fc5cab85f796" returned: 0 in 1.991s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:48 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_38yr277sdevstack@QuobyteHD, size 112.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5ce2e46f-651b-4ab3-b5fd-fc5cab85f796 {{(pid=87128) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:02:48 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Converted 112.00 MB image at 56.23 MB/s Sep 01 02:02:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5ce2e46f-651b-4ab3-b5fd-fc5cab85f796 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:48 devstack sudo[93831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5ce2e46f-651b-4ab3-b5fd-fc5cab85f796 1G Sep 01 02:02:48 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:49 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5ce2e46f-651b-4ab3-b5fd-fc5cab85f796 1G" returned: 0 in 0.402s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:49 devstack cinder-volume[87128]: DEBUG cinder.volume.volume_utils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Downloaded image 64fc298b-4656-41e6-a52e-bd149cb491e9 ((None, [{'url': 'file:///opt/stack/data/glance/images/64fc298b-4656-41e6-a52e-bd149cb491e9', 'metadata': {}}])) to volume 5ce2e46f-651b-4ab3-b5fd-fc5cab85f796 successfully. {{(pid=87128) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:02:49 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Temporary image 64fc298b-4656-41e6-a52e-bd149cb491e9 for user 1dd9e236b4d74540a7ea9216846a8996 is deleted. {{(pid=87128) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:02:49 devstack cinder-volume[87128]: DEBUG cinder.volume.volume_utils [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Marking volume 5ce2e46f-651b-4ab3-b5fd-fc5cab85f796 as bootable. {{(pid=87128) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:02:49 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Copying metadata from image 64fc298b-4656-41e6-a52e-bd149cb491e9 to 5ce2e46f-651b-4ab3-b5fd-fc5cab85f796. {{(pid=87128) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:02:49 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Creating volume glance metadata for volume 5ce2e46f-651b-4ab3-b5fd-fc5cab85f796 backed by image 64fc298b-4656-41e6-a52e-bd149cb491e9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87128) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:02:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61307fa4-38bf-40db-8f18-2db7c425fc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ce2e46f-651b-4ab3-b5fd-fc5cab85f796', 'volume_size': 1, 'image_id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64fc298b-4656-41e6-a52e-bd149cb491e9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0dbd8f0a33a74d5db3271102e89b70d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'created_at': datetime.datetime(2026, 8, 31, 23, 51, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 51, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64fc298b-4656-41e6-a52e-bd149cb491e9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87993888-1a7d-4b42-bf19-943d0fc8b738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:49 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Volume volume-5ce2e46f-651b-4ab3-b5fd-fc5cab85f796 (5ce2e46f-651b-4ab3-b5fd-fc5cab85f796): created successfully Sep 01 02:02:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87993888-1a7d-4b42-bf19-943d0fc8b738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Flow 'volume_create_manager' (1d7f7e92-d75b-4f46-8879-19c12f01723f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:49 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-fd147859-51a1-441d-9090-5149ae75e91a tempest-VolumesImageMetadata-1291049272 None] Created volume successfully. Sep 01 02:02:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1b4dc81f-b61e-4599-84a6-80f2d8a4cb1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Acquiring lock "cinder-4075fdb8-eace-4d9d-a4a2-6e6c5831aa95-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1b4dc81f-b61e-4599-84a6-80f2d8a4cb1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Lock "cinder-4075fdb8-eace-4d9d-a4a2-6e6c5831aa95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1b4dc81f-b61e-4599-84a6-80f2d8a4cb1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Acquiring lock "cinder-quobyte-02c0a6cb-b232-4e98-98bb-867d5a8f597d" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1b4dc81f-b61e-4599-84a6-80f2d8a4cb1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Lock "cinder-quobyte-02c0a6cb-b232-4e98-98bb-867d5a8f597d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1b4dc81f-b61e-4599-84a6-80f2d8a4cb1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Acquiring lock "cinder-quobyte-4075fdb8-eace-4d9d-a4a2-6e6c5831aa95" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1b4dc81f-b61e-4599-84a6-80f2d8a4cb1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Lock "cinder-quobyte-4075fdb8-eace-4d9d-a4a2-6e6c5831aa95" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-1b4dc81f-b61e-4599-84a6-80f2d8a4cb1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Deleting offline snapshot 4075fdb8-eace-4d9d-a4a2-6e6c5831aa95 of volume 02c0a6cb-b232-4e98-98bb-867d5a8f597d {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:02:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-1b4dc81f-b61e-4599-84a6-80f2d8a4cb1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] snapshot_file for this snap is: volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d.4075fdb8-eace-4d9d-a4a2-6e6c5831aa95 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:02:49 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5b7ebf-2fbd-4f6d-ae14-bdd1c6370249]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1b4dc81f-b61e-4599-84a6-80f2d8a4cb1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d.4075fdb8-eace-4d9d-a4a2-6e6c5831aa95 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7b473f60-df11-4bcd-965e-e4c1b86c454e tempest-VolumesImageMetadata-1291049272 None] Acquiring lock "cinder-5ce2e46f-651b-4ab3-b5fd-fc5cab85f796-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:49 devstack sudo[93871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d.4075fdb8-eace-4d9d-a4a2-6e6c5831aa95 Sep 01 02:02:49 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7b473f60-df11-4bcd-965e-e4c1b86c454e tempest-VolumesImageMetadata-1291049272 None] Lock "cinder-5ce2e46f-651b-4ab3-b5fd-fc5cab85f796-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7b473f60-df11-4bcd-965e-e4c1b86c454e tempest-VolumesImageMetadata-1291049272 None] Acquiring lock "cinder-quobyte-5ce2e46f-651b-4ab3-b5fd-fc5cab85f796" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7b473f60-df11-4bcd-965e-e4c1b86c454e tempest-VolumesImageMetadata-1291049272 None] Lock "cinder-quobyte-5ce2e46f-651b-4ab3-b5fd-fc5cab85f796" acquired by "delete_volume" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:50 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f9390d-135c-497f-be7e-914b0624bb87]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b473f60-df11-4bcd-965e-e4c1b86c454e tempest-VolumesImageMetadata-1291049272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5ce2e46f-651b-4ab3-b5fd-fc5cab85f796 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:50 devstack sudo[93873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5ce2e46f-651b-4ab3-b5fd-fc5cab85f796 Sep 01 02:02:50 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:50 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1b4dc81f-b61e-4599-84a6-80f2d8a4cb1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d.4075fdb8-eace-4d9d-a4a2-6e6c5831aa95" returned: 0 in 0.375s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:50 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-1b4dc81f-b61e-4599-84a6-80f2d8a4cb1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:02:50 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[07756d13-67a7-407f-9a4e-3c077a9ce205]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1b4dc81f-b61e-4599-84a6-80f2d8a4cb1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:50 devstack sudo[93878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d Sep 01 02:02:50 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:50 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b473f60-df11-4bcd-965e-e4c1b86c454e tempest-VolumesImageMetadata-1291049272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5ce2e46f-651b-4ab3-b5fd-fc5cab85f796" returned: 0 in 0.363s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b473f60-df11-4bcd-965e-e4c1b86c454e tempest-VolumesImageMetadata-1291049272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5ce2e46f-651b-4ab3-b5fd-fc5cab85f796 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:50 devstack sudo[93883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5ce2e46f-651b-4ab3-b5fd-fc5cab85f796 Sep 01 02:02:50 devstack sudo[93883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:50 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1b4dc81f-b61e-4599-84a6-80f2d8a4cb1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d" returned: 0 in 0.374s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1b4dc81f-b61e-4599-84a6-80f2d8a4cb1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d.4075fdb8-eace-4d9d-a4a2-6e6c5831aa95 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:50 devstack sudo[93888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d.4075fdb8-eace-4d9d-a4a2-6e6c5831aa95 Sep 01 02:02:50 devstack sudo[93888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:50 devstack sudo[93883]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b473f60-df11-4bcd-965e-e4c1b86c454e tempest-VolumesImageMetadata-1291049272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5ce2e46f-651b-4ab3-b5fd-fc5cab85f796" returned: 0 in 0.254s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7b473f60-df11-4bcd-965e-e4c1b86c454e tempest-VolumesImageMetadata-1291049272 None] Lock "cinder-quobyte-5ce2e46f-651b-4ab3-b5fd-fc5cab85f796" released by "delete_volume" :: held 0.658s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:50 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-7b473f60-df11-4bcd-965e-e4c1b86c454e tempest-VolumesImageMetadata-1291049272 None] Created reservations ['b554a5d8-a8f4-4915-b851-561e0af5574a', '4297357f-ca32-4ee4-976f-1bc7b29cdb8e', 'bda05537-9b80-415b-a527-53fe4014ae0b', 'e561e65a-2a25-4bb3-a077-a53e7a5c552e'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:02:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7b473f60-df11-4bcd-965e-e4c1b86c454e tempest-VolumesImageMetadata-1291049272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7b473f60-df11-4bcd-965e-e4c1b86c454e tempest-VolumesImageMetadata-1291049272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:50 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7b473f60-df11-4bcd-965e-e4c1b86c454e tempest-VolumesImageMetadata-1291049272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:50 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7b473f60-df11-4bcd-965e-e4c1b86c454e tempest-VolumesImageMetadata-1291049272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7b473f60-df11-4bcd-965e-e4c1b86c454e tempest-VolumesImageMetadata-1291049272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b473f60-df11-4bcd-965e-e4c1b86c454e tempest-VolumesImageMetadata-1291049272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:50 devstack sudo[93891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:02:50 devstack sudo[93891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:50 devstack sudo[93888]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1b4dc81f-b61e-4599-84a6-80f2d8a4cb1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d.4075fdb8-eace-4d9d-a4a2-6e6c5831aa95" returned: 0 in 0.330s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1b4dc81f-b61e-4599-84a6-80f2d8a4cb1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d.4075fdb8-eace-4d9d-a4a2-6e6c5831aa95 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:50 devstack sudo[93896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d.4075fdb8-eace-4d9d-a4a2-6e6c5831aa95 Sep 01 02:02:50 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:51 devstack sudo[93891]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7b473f60-df11-4bcd-965e-e4c1b86c454e tempest-VolumesImageMetadata-1291049272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.255s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:51 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-7b473f60-df11-4bcd-965e-e4c1b86c454e tempest-VolumesImageMetadata-1291049272 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:02:51 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-7b473f60-df11-4bcd-965e-e4c1b86c454e tempest-VolumesImageMetadata-1291049272 None] Deleted volume successfully. Sep 01 02:02:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7b473f60-df11-4bcd-965e-e4c1b86c454e tempest-VolumesImageMetadata-1291049272 None] Lock "cinder-5ce2e46f-651b-4ab3-b5fd-fc5cab85f796-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:51 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1b4dc81f-b61e-4599-84a6-80f2d8a4cb1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d.4075fdb8-eace-4d9d-a4a2-6e6c5831aa95" returned: 0 in 0.278s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1b4dc81f-b61e-4599-84a6-80f2d8a4cb1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Lock "cinder-quobyte-4075fdb8-eace-4d9d-a4a2-6e6c5831aa95" released by "_delete_snapshot" :: held 1.470s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1b4dc81f-b61e-4599-84a6-80f2d8a4cb1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Lock "cinder-quobyte-02c0a6cb-b232-4e98-98bb-867d5a8f597d" released by "delete_snapshot" :: held 1.493s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:51 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-1b4dc81f-b61e-4599-84a6-80f2d8a4cb1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Created reservations ['643cdae4-98ce-4a54-9cd6-fd9e3b82df70', 'de181e14-13d0-4cbd-b30e-59108345d6a5', '89658d9a-2d0e-4465-adb6-5fad1655ed5f', 'a16abca8-5655-4911-863b-ad6e833b7349'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:02:51 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-1b4dc81f-b61e-4599-84a6-80f2d8a4cb1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Delete snapshot completed successfully. Sep 01 02:02:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1b4dc81f-b61e-4599-84a6-80f2d8a4cb1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Lock "cinder-4075fdb8-eace-4d9d-a4a2-6e6c5831aa95-delete_snapshot" released by "delete_snapshot" :: held 1.640s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b99e250a-b10c-4662-b657-13b8c00d3bb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Acquiring lock "cinder-02c0a6cb-b232-4e98-98bb-867d5a8f597d-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b99e250a-b10c-4662-b657-13b8c00d3bb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Lock "cinder-02c0a6cb-b232-4e98-98bb-867d5a8f597d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b99e250a-b10c-4662-b657-13b8c00d3bb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Acquiring lock "cinder-quobyte-02c0a6cb-b232-4e98-98bb-867d5a8f597d" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b99e250a-b10c-4662-b657-13b8c00d3bb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Lock "cinder-quobyte-02c0a6cb-b232-4e98-98bb-867d5a8f597d" acquired by "delete_volume" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:52 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4a1927-8bac-48b1-9959-fb9a2d964488]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b99e250a-b10c-4662-b657-13b8c00d3bb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:52 devstack sudo[93904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d Sep 01 02:02:52 devstack sudo[93904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:52 devstack sudo[93904]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b99e250a-b10c-4662-b657-13b8c00d3bb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d" returned: 0 in 0.426s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b99e250a-b10c-4662-b657-13b8c00d3bb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:52 devstack sudo[93910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d Sep 01 02:02:52 devstack sudo[93910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:52 devstack sudo[93910]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b99e250a-b10c-4662-b657-13b8c00d3bb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-02c0a6cb-b232-4e98-98bb-867d5a8f597d" returned: 0 in 0.267s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b99e250a-b10c-4662-b657-13b8c00d3bb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Lock "cinder-quobyte-02c0a6cb-b232-4e98-98bb-867d5a8f597d" released by "delete_volume" :: held 0.771s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:52 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:02:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] Flow 'volume_create_manager' (121afc9d-1f01-4d44-b105-41418462dafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd462305-1c3b-4ea7-8091-ebcd99e745e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd462305-1c3b-4ea7-8091-ebcd99e745e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-457210265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae8db6d3-20e0-4625-814e-2b35661e25f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f97e230d7bef4d12ad7060960cfe5cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:53Z,use_quota=True,user_id='97752354ff134faaa3b606ac49d6275f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca3baac-ed76-4385-baf0-8503d489192e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca3baac-ed76-4385-baf0-8503d489192e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (033ac0e9-b406-4c1d-8b9c-d4cb72d755aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (033ac0e9-b406-4c1d-8b9c-d4cb72d755aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae8db6d3-20e0-4625-814e-2b35661e25f0', 'volume_name': 'volume-ae8db6d3-20e0-4625-814e-2b35661e25f0', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc8119f8-66b0-40a6-81e8-b534f8d9bf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc8119f8-66b0-40a6-81e8-b534f8d9bf34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6325f0-4034-4d35-b1eb-83ff3bc424d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:52 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] Volume ae8db6d3-20e0-4625-814e-2b35661e25f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae8db6d3-20e0-4625-814e-2b35661e25f0', 'volume_size': 1} Sep 01 02:02:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:52 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-457210265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae8db6d3-20e0-4625-814e-2b35661e25f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f97e230d7bef4d12ad7060960cfe5cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:53Z,use_quota=True,user_id='97752354ff134faaa3b606ac49d6275f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:02:52 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] Creating volume ae8db6d3-20e0-4625-814e-2b35661e25f0 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:02:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:02:53 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:02:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae8db6d3-20e0-4625-814e-2b35661e25f0 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:53 devstack sudo[93913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae8db6d3-20e0-4625-814e-2b35661e25f0 1073741824 Sep 01 02:02:53 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:53 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-b99e250a-b10c-4662-b657-13b8c00d3bb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Created reservations ['233b899a-deed-41c0-bb99-e723317ac4a4', 'bcf2abb2-714c-4442-9baf-334afa410cba', '5019bf78-b623-4044-8172-18a88cb36403', '6c87f5db-6a00-42a8-b4af-5e8857e0bad7'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:02:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b99e250a-b10c-4662-b657-13b8c00d3bb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b99e250a-b10c-4662-b657-13b8c00d3bb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b99e250a-b10c-4662-b657-13b8c00d3bb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b99e250a-b10c-4662-b657-13b8c00d3bb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b99e250a-b10c-4662-b657-13b8c00d3bb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b99e250a-b10c-4662-b657-13b8c00d3bb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:53 devstack sudo[93915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:02:53 devstack sudo[93915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:53 devstack sudo[93915]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b99e250a-b10c-4662-b657-13b8c00d3bb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.328s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:53 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-b99e250a-b10c-4662-b657-13b8c00d3bb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:02:53 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-b99e250a-b10c-4662-b657-13b8c00d3bb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Deleted volume successfully. Sep 01 02:02:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b99e250a-b10c-4662-b657-13b8c00d3bb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1229105390 None] Lock "cinder-02c0a6cb-b232-4e98-98bb-867d5a8f597d-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:53 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae8db6d3-20e0-4625-814e-2b35661e25f0 1073741824" returned: 0 in 0.528s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae8db6d3-20e0-4625-814e-2b35661e25f0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:53 devstack sudo[93922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae8db6d3-20e0-4625-814e-2b35661e25f0 Sep 01 02:02:53 devstack sudo[93922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:53 devstack sudo[93922]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae8db6d3-20e0-4625-814e-2b35661e25f0" returned: 0 in 0.272s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:02:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:53 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6325f0-4034-4d35-b1eb-83ff3bc424d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae8db6d3-20e0-4625-814e-2b35661e25f0', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:53 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764283b9-dc4b-43bf-a57c-a9b4ccbf145e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:53 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] Volume volume-ae8db6d3-20e0-4625-814e-2b35661e25f0 (ae8db6d3-20e0-4625-814e-2b35661e25f0): created successfully Sep 01 02:02:53 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764283b9-dc4b-43bf-a57c-a9b4ccbf145e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:53 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] Flow 'volume_create_manager' (121afc9d-1f01-4d44-b105-41418462dafb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:53 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-446aad07-5406-452b-8005-5d9fa6485718 tempest-AttachVolumeNegativeTest-545642174 None] Created volume successfully. Sep 01 02:02:55 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:02:55 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] Flow 'volume_create_manager' (e628ac94-0541-4730-8530-3027420e06ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:55 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c64bc8-6411-46d1-8d1a-ece46d4fa24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:55 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c64bc8-6411-46d1-8d1a-ece46d4fa24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1785455216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6389efb-ddc2-4b54-bbeb-55e841be0dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c418dc4cdb3b48809eb3b6b8ee828cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:55Z,use_quota=True,user_id='726dc10aaf3f4729999bfbcb636a834f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:55 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8283ab80-7aa5-48d7-9052-8e8ca7066756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:55 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8283ab80-7aa5-48d7-9052-8e8ca7066756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:55 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d54c8d15-974d-42ee-a5d8-9f34d3252915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:55 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d54c8d15-974d-42ee-a5d8-9f34d3252915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6389efb-ddc2-4b54-bbeb-55e841be0dc4', 'volume_name': 'volume-a6389efb-ddc2-4b54-bbeb-55e841be0dc4', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:55 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d9ca108-bbdd-4c7a-882f-d8defcacc35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:55 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d9ca108-bbdd-4c7a-882f-d8defcacc35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:55 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d901df-de2a-4d4d-9589-ff5251694d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:55 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] Volume a6389efb-ddc2-4b54-bbeb-55e841be0dc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6389efb-ddc2-4b54-bbeb-55e841be0dc4', 'volume_size': 1} Sep 01 02:02:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:55 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1785455216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6389efb-ddc2-4b54-bbeb-55e841be0dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c418dc4cdb3b48809eb3b6b8ee828cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:55Z,use_quota=True,user_id='726dc10aaf3f4729999bfbcb636a834f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:02:55 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] Creating volume a6389efb-ddc2-4b54-bbeb-55e841be0dc4 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:02:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:55 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:55 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:55 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:02:55 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:02:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a6389efb-ddc2-4b54-bbeb-55e841be0dc4 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:55 devstack sudo[93931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a6389efb-ddc2-4b54-bbeb-55e841be0dc4 1073741824 Sep 01 02:02:55 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-e7c9e56b-dcf2-4074-9784-e4192d1a7f69 req-eb070b2e-b517-4878-80a5-cc43dffe85fe tempest-AttachVolumeNegativeTest-545642174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:56 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a6389efb-ddc2-4b54-bbeb-55e841be0dc4 1073741824" returned: 0 in 0.501s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a6389efb-ddc2-4b54-bbeb-55e841be0dc4 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:56 devstack sudo[93946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a6389efb-ddc2-4b54-bbeb-55e841be0dc4 Sep 01 02:02:56 devstack sudo[93946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:56 devstack sudo[93946]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a6389efb-ddc2-4b54-bbeb-55e841be0dc4" returned: 0 in 0.314s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:56 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:02:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-e7c9e56b-dcf2-4074-9784-e4192d1a7f69 req-eb070b2e-b517-4878-80a5-cc43dffe85fe tempest-AttachVolumeNegativeTest-545642174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.534s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d901df-de2a-4d4d-9589-ff5251694d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6389efb-ddc2-4b54-bbeb-55e841be0dc4', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930084a2-e9d8-4d30-a1a7-69b02c80d689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-e7c9e56b-dcf2-4074-9784-e4192d1a7f69 req-eb070b2e-b517-4878-80a5-cc43dffe85fe tempest-AttachVolumeNegativeTest-545642174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:56 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] Volume volume-a6389efb-ddc2-4b54-bbeb-55e841be0dc4 (a6389efb-ddc2-4b54-bbeb-55e841be0dc4): created successfully Sep 01 02:02:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930084a2-e9d8-4d30-a1a7-69b02c80d689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] Flow 'volume_create_manager' (e628ac94-0541-4730-8530-3027420e06ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:56 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-10a39f56-c521-46ed-895e-fd12687fa58c tempest-AbsoluteLimitsTests-710628816 None] Created volume successfully. Sep 01 02:02:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-e7c9e56b-dcf2-4074-9784-e4192d1a7f69 req-eb070b2e-b517-4878-80a5-cc43dffe85fe tempest-AttachVolumeNegativeTest-545642174 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb', 'name': 'volume-ae8db6d3-20e0-4625-814e-2b35661e25f0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '639069d9-fd28-4264-ba44-0bca6926ed37', 'enforce_multipath': True} {{(pid=87128) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:02:56 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-e7c9e56b-dcf2-4074-9784-e4192d1a7f69 req-eb070b2e-b517-4878-80a5-cc43dffe85fe tempest-AttachVolumeNegativeTest-545642174 None] attachment_update completed successfully. Sep 01 02:02:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-20cac15a-19cf-4961-86ef-7f3783cd7f7e tempest-AbsoluteLimitsTests-710628816 None] Acquiring lock "cinder-a6389efb-ddc2-4b54-bbeb-55e841be0dc4-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-20cac15a-19cf-4961-86ef-7f3783cd7f7e tempest-AbsoluteLimitsTests-710628816 None] Lock "cinder-a6389efb-ddc2-4b54-bbeb-55e841be0dc4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-20cac15a-19cf-4961-86ef-7f3783cd7f7e tempest-AbsoluteLimitsTests-710628816 None] Acquiring lock "cinder-quobyte-a6389efb-ddc2-4b54-bbeb-55e841be0dc4" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-20cac15a-19cf-4961-86ef-7f3783cd7f7e tempest-AbsoluteLimitsTests-710628816 None] Lock "cinder-quobyte-a6389efb-ddc2-4b54-bbeb-55e841be0dc4" acquired by "delete_volume" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:57 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc80a69-8113-4078-b867-4720215e0830]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-20cac15a-19cf-4961-86ef-7f3783cd7f7e tempest-AbsoluteLimitsTests-710628816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a6389efb-ddc2-4b54-bbeb-55e841be0dc4 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:57 devstack sudo[94332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a6389efb-ddc2-4b54-bbeb-55e841be0dc4 Sep 01 02:02:58 devstack sudo[94332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:58 devstack sudo[94332]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-20cac15a-19cf-4961-86ef-7f3783cd7f7e tempest-AbsoluteLimitsTests-710628816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a6389efb-ddc2-4b54-bbeb-55e841be0dc4" returned: 0 in 0.522s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-20cac15a-19cf-4961-86ef-7f3783cd7f7e tempest-AbsoluteLimitsTests-710628816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a6389efb-ddc2-4b54-bbeb-55e841be0dc4 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:58 devstack sudo[94337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a6389efb-ddc2-4b54-bbeb-55e841be0dc4 Sep 01 02:02:58 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:58 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-20cac15a-19cf-4961-86ef-7f3783cd7f7e tempest-AbsoluteLimitsTests-710628816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a6389efb-ddc2-4b54-bbeb-55e841be0dc4" returned: 0 in 0.268s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:58 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-20cac15a-19cf-4961-86ef-7f3783cd7f7e tempest-AbsoluteLimitsTests-710628816 None] Lock "cinder-quobyte-a6389efb-ddc2-4b54-bbeb-55e841be0dc4" released by "delete_volume" :: held 0.840s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:58 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-20cac15a-19cf-4961-86ef-7f3783cd7f7e tempest-AbsoluteLimitsTests-710628816 None] Created reservations ['55f328b9-881f-42b4-aa3e-df996abc7a3b', '6d0ee61e-5f8f-4573-a6fa-c5cd91774be0', '92d5dc22-8772-475a-9b54-0c26edc56772', '01942184-5ec9-474c-9f95-075617e6c829'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:02:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-20cac15a-19cf-4961-86ef-7f3783cd7f7e tempest-AbsoluteLimitsTests-710628816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-20cac15a-19cf-4961-86ef-7f3783cd7f7e tempest-AbsoluteLimitsTests-710628816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-20cac15a-19cf-4961-86ef-7f3783cd7f7e tempest-AbsoluteLimitsTests-710628816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-20cac15a-19cf-4961-86ef-7f3783cd7f7e tempest-AbsoluteLimitsTests-710628816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-20cac15a-19cf-4961-86ef-7f3783cd7f7e tempest-AbsoluteLimitsTests-710628816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-20cac15a-19cf-4961-86ef-7f3783cd7f7e tempest-AbsoluteLimitsTests-710628816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:58 devstack sudo[94340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:02:58 devstack sudo[94340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:59 devstack sudo[94340]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-20cac15a-19cf-4961-86ef-7f3783cd7f7e tempest-AbsoluteLimitsTests-710628816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.385s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:59 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-20cac15a-19cf-4961-86ef-7f3783cd7f7e tempest-AbsoluteLimitsTests-710628816 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:02:59 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-20cac15a-19cf-4961-86ef-7f3783cd7f7e tempest-AbsoluteLimitsTests-710628816 None] Deleted volume successfully. Sep 01 02:02:59 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-20cac15a-19cf-4961-86ef-7f3783cd7f7e tempest-AbsoluteLimitsTests-710628816 None] Lock "cinder-a6389efb-ddc2-4b54-bbeb-55e841be0dc4-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] Flow 'volume_create_manager' (00dfb886-4ffe-428e-8823-f8b47a4a990d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a446a7e0-630d-4662-be8a-f40fcbd197d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a446a7e0-630d-4662-be8a-f40fcbd197d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1901779743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa05dfc-e62b-4c99-9011-2aa984c9c727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7df08bf5c6e943029d0bc3c0deeb8959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:02Z,use_quota=True,user_id='089e8161ca924ad7896a5bea8c5622b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd8693a7-dc93-4f81-8050-bf182ef13b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd8693a7-dc93-4f81-8050-bf182ef13b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a77d298-d791-4d49-be87-ba117f707d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a77d298-d791-4d49-be87-ba117f707d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffa05dfc-e62b-4c99-9011-2aa984c9c727', 'volume_name': 'volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (098023ab-4d7c-4cf9-912a-d374d6b291da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (098023ab-4d7c-4cf9-912a-d374d6b291da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eb94fed-ffc6-425a-80cb-55a7e9aeab53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:02 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] Volume ffa05dfc-e62b-4c99-9011-2aa984c9c727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727', 'volume_size': 1} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1901779743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa05dfc-e62b-4c99-9011-2aa984c9c727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7df08bf5c6e943029d0bc3c0deeb8959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:02Z,use_quota=True,user_id='089e8161ca924ad7896a5bea8c5622b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] Creating volume ffa05dfc-e62b-4c99-9011-2aa984c9c727 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:03:02 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:02 devstack sudo[94355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727 1073741824 Sep 01 02:03:02 devstack sudo[94355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] Flow 'volume_create_manager' (3745d6d4-55b3-4605-bcde-7b54b535d2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5053bf04-6d0b-40b0-881a-a0be56744fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5053bf04-6d0b-40b0-881a-a0be56744fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-743495507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a0214c-db64-4fdb-b80e-bdd635af0bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f53f3ab35f0487d8442cf12da1fa192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:02Z,use_quota=True,user_id='4798cfcc0d0b4166a6fd2fabc87ec847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f58a2f1-4fec-49da-8a44-4be9ac4cf893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f58a2f1-4fec-49da-8a44-4be9ac4cf893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff8cbca-801b-4381-87ed-98a2b52fdb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff8cbca-801b-4381-87ed-98a2b52fdb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8a0214c-db64-4fdb-b80e-bdd635af0bec', 'volume_name': 'volume-a8a0214c-db64-4fdb-b80e-bdd635af0bec', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82c033a-698f-417f-a2cd-9694f19b36e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82c033a-698f-417f-a2cd-9694f19b36e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c159a5-40ca-4fb7-80a5-ce6286206555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:02 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] Volume a8a0214c-db64-4fdb-b80e-bdd635af0bec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8a0214c-db64-4fdb-b80e-bdd635af0bec', 'volume_size': 1} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:02 devstack sudo[94355]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727 1073741824" returned: 0 in 0.606s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:02 devstack sudo[94362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727 Sep 01 02:03:02 devstack sudo[94362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:03 devstack sudo[94362]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727" returned: 0 in 0.321s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:03 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:03:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.824s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:03 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-743495507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a0214c-db64-4fdb-b80e-bdd635af0bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f53f3ab35f0487d8442cf12da1fa192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:02Z,use_quota=True,user_id='4798cfcc0d0b4166a6fd2fabc87ec847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:03:03 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] Creating volume a8a0214c-db64-4fdb-b80e-bdd635af0bec {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:03:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:03 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:03 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:03 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:03:03 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:03:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a8a0214c-db64-4fdb-b80e-bdd635af0bec 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eb94fed-ffc6-425a-80cb-55a7e9aeab53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:03 devstack sudo[94365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a8a0214c-db64-4fdb-b80e-bdd635af0bec 1073741824 Sep 01 02:03:03 devstack sudo[94365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adb3a70d-4d5f-4349-b02b-d1f369889918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:03 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] Volume volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727 (ffa05dfc-e62b-4c99-9011-2aa984c9c727): created successfully Sep 01 02:03:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adb3a70d-4d5f-4349-b02b-d1f369889918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] Flow 'volume_create_manager' (00dfb886-4ffe-428e-8823-f8b47a4a990d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:03 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-3516f27d-fedc-4fea-8aac-2311d1b2a16c tempest-SnapshotMetadataTestJSON-1168715544 None] Created volume successfully. Sep 01 02:03:03 devstack sudo[94365]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a8a0214c-db64-4fdb-b80e-bdd635af0bec 1073741824" returned: 0 in 0.559s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a8a0214c-db64-4fdb-b80e-bdd635af0bec {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:03 devstack sudo[94375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a8a0214c-db64-4fdb-b80e-bdd635af0bec Sep 01 02:03:03 devstack sudo[94375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6242dc52-d8ac-427b-99d9-8d67f413daca tempest-SnapshotMetadataTestJSON-1168715544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:04 devstack sudo[94375]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a8a0214c-db64-4fdb-b80e-bdd635af0bec" returned: 0 in 0.473s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:04 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:03:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6242dc52-d8ac-427b-99d9-8d67f413daca tempest-SnapshotMetadataTestJSON-1168715544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.033s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c159a5-40ca-4fb7-80a5-ce6286206555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8a0214c-db64-4fdb-b80e-bdd635af0bec', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dcaf7fc-22a3-4045-ac10-a4d29861c41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:04 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-6242dc52-d8ac-427b-99d9-8d67f413daca tempest-SnapshotMetadataTestJSON-1168715544 None] Creating offline snapshot 9f15e0d7-5ca9-4094-a227-789a27d0cd7c of volume ffa05dfc-e62b-4c99-9011-2aa984c9c727 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:03:04 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] Volume volume-a8a0214c-db64-4fdb-b80e-bdd635af0bec (a8a0214c-db64-4fdb-b80e-bdd635af0bec): created successfully Sep 01 02:03:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dcaf7fc-22a3-4045-ac10-a4d29861c41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] Flow 'volume_create_manager' (3745d6d4-55b3-4605-bcde-7b54b535d2c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:04 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cf7e8d-cc23-4119-9a0f-4aaf8e6048e0]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6242dc52-d8ac-427b-99d9-8d67f413daca tempest-SnapshotMetadataTestJSON-1168715544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:04 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-e526e6f0-8e3c-4154-992f-eeb996bffcf7 tempest-AttachVolumeTestJSON-602593005 None] Created volume successfully. Sep 01 02:03:04 devstack sudo[94389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727 Sep 01 02:03:04 devstack sudo[94389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:04 devstack sudo[94389]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6242dc52-d8ac-427b-99d9-8d67f413daca tempest-SnapshotMetadataTestJSON-1168715544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727" returned: 0 in 0.519s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6242dc52-d8ac-427b-99d9-8d67f413daca tempest-SnapshotMetadataTestJSON-1168715544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727.9f15e0d7-5ca9-4094-a227-789a27d0cd7c 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:05 devstack sudo[94397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727.9f15e0d7-5ca9-4094-a227-789a27d0cd7c 1G Sep 01 02:03:05 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:05 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6242dc52-d8ac-427b-99d9-8d67f413daca tempest-SnapshotMetadataTestJSON-1168715544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727.9f15e0d7-5ca9-4094-a227-789a27d0cd7c 1G" returned: 0 in 0.568s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6242dc52-d8ac-427b-99d9-8d67f413daca tempest-SnapshotMetadataTestJSON-1168715544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727.9f15e0d7-5ca9-4094-a227-789a27d0cd7c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:05 devstack sudo[94407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727.9f15e0d7-5ca9-4094-a227-789a27d0cd7c Sep 01 02:03:05 devstack sudo[94407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:05 devstack sudo[94407]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6242dc52-d8ac-427b-99d9-8d67f413daca tempest-SnapshotMetadataTestJSON-1168715544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727.9f15e0d7-5ca9-4094-a227-789a27d0cd7c" returned: 0 in 0.404s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:05 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-6242dc52-d8ac-427b-99d9-8d67f413daca tempest-SnapshotMetadataTestJSON-1168715544 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727.9f15e0d7-5ca9-4094-a227-789a27d0cd7c is being set with open permissions: ugo+rw Sep 01 02:03:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6242dc52-d8ac-427b-99d9-8d67f413daca tempest-SnapshotMetadataTestJSON-1168715544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727.9f15e0d7-5ca9-4094-a227-789a27d0cd7c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:06 devstack sudo[94420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727.9f15e0d7-5ca9-4094-a227-789a27d0cd7c Sep 01 02:03:06 devstack sudo[94420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-4a43ff5f-12d6-44a9-be49-b96f6f66e08e req-86d98eec-a3d4-445d-a2c1-11d58eb24331 tempest-AttachVolumeTestJSON-602593005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:06 devstack sudo[94420]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6242dc52-d8ac-427b-99d9-8d67f413daca tempest-SnapshotMetadataTestJSON-1168715544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727.9f15e0d7-5ca9-4094-a227-789a27d0cd7c" returned: 0 in 0.387s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6242dc52-d8ac-427b-99d9-8d67f413daca tempest-SnapshotMetadataTestJSON-1168715544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:06 devstack sudo[94425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727.info Sep 01 02:03:06 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:06 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6242dc52-d8ac-427b-99d9-8d67f413daca tempest-SnapshotMetadataTestJSON-1168715544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727.info" returned: 0 in 0.313s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:06 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-6242dc52-d8ac-427b-99d9-8d67f413daca tempest-SnapshotMetadataTestJSON-1168715544 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727.info is being set with open permissions: ugo+rw Sep 01 02:03:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6242dc52-d8ac-427b-99d9-8d67f413daca tempest-SnapshotMetadataTestJSON-1168715544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:06 devstack sudo[94428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727.info Sep 01 02:03:06 devstack sudo[94428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:07 devstack sudo[94428]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6242dc52-d8ac-427b-99d9-8d67f413daca tempest-SnapshotMetadataTestJSON-1168715544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727.info" returned: 0 in 0.360s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6242dc52-d8ac-427b-99d9-8d67f413daca tempest-SnapshotMetadataTestJSON-1168715544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.743s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-4a43ff5f-12d6-44a9-be49-b96f6f66e08e req-86d98eec-a3d4-445d-a2c1-11d58eb24331 tempest-AttachVolumeTestJSON-602593005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-4a43ff5f-12d6-44a9-be49-b96f6f66e08e req-86d98eec-a3d4-445d-a2c1-11d58eb24331 tempest-AttachVolumeTestJSON-602593005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.052s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:07 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-6242dc52-d8ac-427b-99d9-8d67f413daca tempest-SnapshotMetadataTestJSON-1168715544 None] Create snapshot completed successfully Sep 01 02:03:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-4a43ff5f-12d6-44a9-be49-b96f6f66e08e req-86d98eec-a3d4-445d-a2c1-11d58eb24331 tempest-AttachVolumeTestJSON-602593005 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb', 'name': 'volume-a8a0214c-db64-4fdb-b80e-bdd635af0bec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f60b5c41-0943-4134-83c0-be4a0f4fd615', 'enforce_multipath': True} {{(pid=87128) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:03:07 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:DELETE=9,cinder:SELECT=102,cinder:INSERT=37,cinder:UPDATE=121 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:03:07 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-4a43ff5f-12d6-44a9-be49-b96f6f66e08e req-86d98eec-a3d4-445d-a2c1-11d58eb24331 tempest-AttachVolumeTestJSON-602593005 None] attachment_update completed successfully. Sep 01 02:03:09 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5ffcdfa3-60bd-4a51-94b5-2d1f5e81401d tempest-SnapshotMetadataTestJSON-1168715544 None] Acquiring lock "cinder-9f15e0d7-5ca9-4094-a227-789a27d0cd7c-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:09 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5ffcdfa3-60bd-4a51-94b5-2d1f5e81401d tempest-SnapshotMetadataTestJSON-1168715544 None] Lock "cinder-9f15e0d7-5ca9-4094-a227-789a27d0cd7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:09 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5ffcdfa3-60bd-4a51-94b5-2d1f5e81401d tempest-SnapshotMetadataTestJSON-1168715544 None] Acquiring lock "cinder-quobyte-ffa05dfc-e62b-4c99-9011-2aa984c9c727" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:09 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5ffcdfa3-60bd-4a51-94b5-2d1f5e81401d tempest-SnapshotMetadataTestJSON-1168715544 None] Lock "cinder-quobyte-ffa05dfc-e62b-4c99-9011-2aa984c9c727" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:09 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5ffcdfa3-60bd-4a51-94b5-2d1f5e81401d tempest-SnapshotMetadataTestJSON-1168715544 None] Acquiring lock "cinder-quobyte-9f15e0d7-5ca9-4094-a227-789a27d0cd7c" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:09 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5ffcdfa3-60bd-4a51-94b5-2d1f5e81401d tempest-SnapshotMetadataTestJSON-1168715544 None] Lock "cinder-quobyte-9f15e0d7-5ca9-4094-a227-789a27d0cd7c" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:09 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-5ffcdfa3-60bd-4a51-94b5-2d1f5e81401d tempest-SnapshotMetadataTestJSON-1168715544 None] Deleting offline snapshot 9f15e0d7-5ca9-4094-a227-789a27d0cd7c of volume ffa05dfc-e62b-4c99-9011-2aa984c9c727 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:03:09 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-5ffcdfa3-60bd-4a51-94b5-2d1f5e81401d tempest-SnapshotMetadataTestJSON-1168715544 None] snapshot_file for this snap is: volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727.9f15e0d7-5ca9-4094-a227-789a27d0cd7c {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:03:09 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dc314f-f283-41e8-afe6-080bff4d964d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5ffcdfa3-60bd-4a51-94b5-2d1f5e81401d tempest-SnapshotMetadataTestJSON-1168715544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727.9f15e0d7-5ca9-4094-a227-789a27d0cd7c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:09 devstack sudo[94475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727.9f15e0d7-5ca9-4094-a227-789a27d0cd7c Sep 01 02:03:09 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:10 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5ffcdfa3-60bd-4a51-94b5-2d1f5e81401d tempest-SnapshotMetadataTestJSON-1168715544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727.9f15e0d7-5ca9-4094-a227-789a27d0cd7c" returned: 0 in 0.817s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:10 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-5ffcdfa3-60bd-4a51-94b5-2d1f5e81401d tempest-SnapshotMetadataTestJSON-1168715544 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:03:10 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[056219e3-3a7a-4ee8-a1eb-c51c7790875f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5ffcdfa3-60bd-4a51-94b5-2d1f5e81401d tempest-SnapshotMetadataTestJSON-1168715544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:10 devstack sudo[94487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727 Sep 01 02:03:10 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:10 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5ffcdfa3-60bd-4a51-94b5-2d1f5e81401d tempest-SnapshotMetadataTestJSON-1168715544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727" returned: 0 in 0.517s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5ffcdfa3-60bd-4a51-94b5-2d1f5e81401d tempest-SnapshotMetadataTestJSON-1168715544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727.9f15e0d7-5ca9-4094-a227-789a27d0cd7c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:10 devstack sudo[94492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727.9f15e0d7-5ca9-4094-a227-789a27d0cd7c Sep 01 02:03:10 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:11 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5ffcdfa3-60bd-4a51-94b5-2d1f5e81401d tempest-SnapshotMetadataTestJSON-1168715544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727.9f15e0d7-5ca9-4094-a227-789a27d0cd7c" returned: 0 in 0.602s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5ffcdfa3-60bd-4a51-94b5-2d1f5e81401d tempest-SnapshotMetadataTestJSON-1168715544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727.9f15e0d7-5ca9-4094-a227-789a27d0cd7c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:11 devstack sudo[94499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727.9f15e0d7-5ca9-4094-a227-789a27d0cd7c Sep 01 02:03:11 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:11 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5ffcdfa3-60bd-4a51-94b5-2d1f5e81401d tempest-SnapshotMetadataTestJSON-1168715544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727.9f15e0d7-5ca9-4094-a227-789a27d0cd7c" returned: 0 in 0.343s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5ffcdfa3-60bd-4a51-94b5-2d1f5e81401d tempest-SnapshotMetadataTestJSON-1168715544 None] Lock "cinder-quobyte-9f15e0d7-5ca9-4094-a227-789a27d0cd7c" released by "_delete_snapshot" :: held 2.543s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5ffcdfa3-60bd-4a51-94b5-2d1f5e81401d tempest-SnapshotMetadataTestJSON-1168715544 None] Lock "cinder-quobyte-ffa05dfc-e62b-4c99-9011-2aa984c9c727" released by "delete_snapshot" :: held 2.600s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:11 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-5ffcdfa3-60bd-4a51-94b5-2d1f5e81401d tempest-SnapshotMetadataTestJSON-1168715544 None] Created reservations ['5fbc95f1-64b5-4ce9-a843-54f5d3f63685', '0eb4651b-e0f4-4254-9c1c-f90eb3b0be1d', '1b11925e-9ac1-43f1-a09d-ce1e7f7cdb41', '8789b2a3-71f0-4326-bd20-ad4e3e9957ad'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:03:11 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-5ffcdfa3-60bd-4a51-94b5-2d1f5e81401d tempest-SnapshotMetadataTestJSON-1168715544 None] Delete snapshot completed successfully. Sep 01 02:03:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5ffcdfa3-60bd-4a51-94b5-2d1f5e81401d tempest-SnapshotMetadataTestJSON-1168715544 None] Lock "cinder-9f15e0d7-5ca9-4094-a227-789a27d0cd7c-delete_snapshot" released by "delete_snapshot" :: held 2.849s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:12 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-84b71909-4a72-400d-9ad0-28185fa85b4c tempest-SnapshotMetadataTestJSON-1168715544 None] Acquiring lock "cinder-ffa05dfc-e62b-4c99-9011-2aa984c9c727-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:12 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-84b71909-4a72-400d-9ad0-28185fa85b4c tempest-SnapshotMetadataTestJSON-1168715544 None] Lock "cinder-ffa05dfc-e62b-4c99-9011-2aa984c9c727-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:12 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-84b71909-4a72-400d-9ad0-28185fa85b4c tempest-SnapshotMetadataTestJSON-1168715544 None] Acquiring lock "cinder-quobyte-ffa05dfc-e62b-4c99-9011-2aa984c9c727" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:12 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-84b71909-4a72-400d-9ad0-28185fa85b4c tempest-SnapshotMetadataTestJSON-1168715544 None] Lock "cinder-quobyte-ffa05dfc-e62b-4c99-9011-2aa984c9c727" acquired by "delete_volume" :: waited 0.041s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:12 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[1497dbc6-5266-4297-a50c-b4815d00a64f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-84b71909-4a72-400d-9ad0-28185fa85b4c tempest-SnapshotMetadataTestJSON-1168715544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:12 devstack sudo[94504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727 Sep 01 02:03:12 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:13 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-84b71909-4a72-400d-9ad0-28185fa85b4c tempest-SnapshotMetadataTestJSON-1168715544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727" returned: 0 in 0.515s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-84b71909-4a72-400d-9ad0-28185fa85b4c tempest-SnapshotMetadataTestJSON-1168715544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:13 devstack sudo[94510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727 Sep 01 02:03:13 devstack sudo[94510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:13 devstack sudo[94510]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-84b71909-4a72-400d-9ad0-28185fa85b4c tempest-SnapshotMetadataTestJSON-1168715544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ffa05dfc-e62b-4c99-9011-2aa984c9c727" returned: 0 in 0.327s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:13 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-84b71909-4a72-400d-9ad0-28185fa85b4c tempest-SnapshotMetadataTestJSON-1168715544 None] Lock "cinder-quobyte-ffa05dfc-e62b-4c99-9011-2aa984c9c727" released by "delete_volume" :: held 0.935s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:13 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-84b71909-4a72-400d-9ad0-28185fa85b4c tempest-SnapshotMetadataTestJSON-1168715544 None] Created reservations ['b7923ef6-c7cd-4fd6-bc05-40948854f703', '1f67e6fc-bbe0-4b34-bb25-b942ebc52049', '0a376341-8e01-44a9-80a6-178dd0e4b18e', 'b37e4a98-c5ae-423d-8ef0-fab9a766ee27'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:03:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-84b71909-4a72-400d-9ad0-28185fa85b4c tempest-SnapshotMetadataTestJSON-1168715544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-84b71909-4a72-400d-9ad0-28185fa85b4c tempest-SnapshotMetadataTestJSON-1168715544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:13 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-84b71909-4a72-400d-9ad0-28185fa85b4c tempest-SnapshotMetadataTestJSON-1168715544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:13 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-84b71909-4a72-400d-9ad0-28185fa85b4c tempest-SnapshotMetadataTestJSON-1168715544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-84b71909-4a72-400d-9ad0-28185fa85b4c tempest-SnapshotMetadataTestJSON-1168715544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-84b71909-4a72-400d-9ad0-28185fa85b4c tempest-SnapshotMetadataTestJSON-1168715544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:13 devstack sudo[94513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:03:13 devstack sudo[94513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:14 devstack sudo[94513]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-84b71909-4a72-400d-9ad0-28185fa85b4c tempest-SnapshotMetadataTestJSON-1168715544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.348s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:14 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-84b71909-4a72-400d-9ad0-28185fa85b4c tempest-SnapshotMetadataTestJSON-1168715544 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:03:14 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-84b71909-4a72-400d-9ad0-28185fa85b4c tempest-SnapshotMetadataTestJSON-1168715544 None] Deleted volume successfully. Sep 01 02:03:14 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-84b71909-4a72-400d-9ad0-28185fa85b4c tempest-SnapshotMetadataTestJSON-1168715544 None] Lock "cinder-ffa05dfc-e62b-4c99-9011-2aa984c9c727-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:16 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:03:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:16 devstack sudo[94629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:03:16 devstack sudo[94629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:17 devstack sudo[94629]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.509s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:17 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:03:17 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager._thread_info {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:03:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread count: 28 {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:03:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread info: [<_MainThread(MainThread, started 128688016527488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:03:21 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=102,cinder:UPDATE=113,cinder:DELETE=11,cinder:INSERT=30 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:03:21 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:03:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] Flow 'volume_create_manager' (631b1cd5-7ef4-46b9-a83d-061864611c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e624c786-3fcb-4da1-8429-2b7ed4bea33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e624c786-3fcb-4da1-8429-2b7ed4bea33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-849268479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0cc04e8-4fe6-42d6-8d96-35e96d3f5e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b09a52d0fc431fb12b6e176fe2c2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:21Z,use_quota=True,user_id='67b85e27df88429d955cbd55e89a2624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4eaa58a-7e28-4467-8d14-5cdd10725e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4eaa58a-7e28-4467-8d14-5cdd10725e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf94740e-90cb-41d1-be09-a19c50331cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf94740e-90cb-41d1-be09-a19c50331cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0cc04e8-4fe6-42d6-8d96-35e96d3f5e95', 'volume_name': 'volume-f0cc04e8-4fe6-42d6-8d96-35e96d3f5e95', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd594447-78f9-4f84-a2fc-fab59a45726b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd594447-78f9-4f84-a2fc-fab59a45726b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca08d771-8045-4c50-b0b7-ba960d3951ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:21 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] Volume f0cc04e8-4fe6-42d6-8d96-35e96d3f5e95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0cc04e8-4fe6-42d6-8d96-35e96d3f5e95', 'volume_size': 1} Sep 01 02:03:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-849268479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0cc04e8-4fe6-42d6-8d96-35e96d3f5e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b09a52d0fc431fb12b6e176fe2c2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:21Z,use_quota=True,user_id='67b85e27df88429d955cbd55e89a2624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:03:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] Creating volume f0cc04e8-4fe6-42d6-8d96-35e96d3f5e95 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:03:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:03:21 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:03:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f0cc04e8-4fe6-42d6-8d96-35e96d3f5e95 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:21 devstack sudo[94683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f0cc04e8-4fe6-42d6-8d96-35e96d3f5e95 1073741824 Sep 01 02:03:21 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:22 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f0cc04e8-4fe6-42d6-8d96-35e96d3f5e95 1073741824" returned: 0 in 0.914s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f0cc04e8-4fe6-42d6-8d96-35e96d3f5e95 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:22 devstack sudo[94707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f0cc04e8-4fe6-42d6-8d96-35e96d3f5e95 Sep 01 02:03:22 devstack sudo[94707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:22 devstack sudo[94707]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f0cc04e8-4fe6-42d6-8d96-35e96d3f5e95" returned: 0 in 0.455s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:22 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:03:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:23 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca08d771-8045-4c50-b0b7-ba960d3951ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0cc04e8-4fe6-42d6-8d96-35e96d3f5e95', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:23 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37db91b4-8d29-4760-998a-b56623fe12c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:23 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] Volume volume-f0cc04e8-4fe6-42d6-8d96-35e96d3f5e95 (f0cc04e8-4fe6-42d6-8d96-35e96d3f5e95): created successfully Sep 01 02:03:23 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37db91b4-8d29-4760-998a-b56623fe12c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:23 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] Flow 'volume_create_manager' (631b1cd5-7ef4-46b9-a83d-061864611c67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:23 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-5d80fd3f-d8b3-4735-819e-a0ce844185c1 tempest-VolumesMetadataTest-1289029353 None] Created volume successfully. Sep 01 02:03:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3fbbd6dc-acf0-486c-8494-c592642b1ab7 tempest-VolumesMetadataTest-1289029353 None] Acquiring lock "cinder-f0cc04e8-4fe6-42d6-8d96-35e96d3f5e95-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3fbbd6dc-acf0-486c-8494-c592642b1ab7 tempest-VolumesMetadataTest-1289029353 None] Lock "cinder-f0cc04e8-4fe6-42d6-8d96-35e96d3f5e95-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3fbbd6dc-acf0-486c-8494-c592642b1ab7 tempest-VolumesMetadataTest-1289029353 None] Acquiring lock "cinder-quobyte-f0cc04e8-4fe6-42d6-8d96-35e96d3f5e95" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3fbbd6dc-acf0-486c-8494-c592642b1ab7 tempest-VolumesMetadataTest-1289029353 None] Lock "cinder-quobyte-f0cc04e8-4fe6-42d6-8d96-35e96d3f5e95" acquired by "delete_volume" :: waited 0.021s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:24 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c04c3ad-1ce7-4f4f-b834-064d4a2ed983]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3fbbd6dc-acf0-486c-8494-c592642b1ab7 tempest-VolumesMetadataTest-1289029353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f0cc04e8-4fe6-42d6-8d96-35e96d3f5e95 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:24 devstack sudo[94710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f0cc04e8-4fe6-42d6-8d96-35e96d3f5e95 Sep 01 02:03:24 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:24 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3fbbd6dc-acf0-486c-8494-c592642b1ab7 tempest-VolumesMetadataTest-1289029353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f0cc04e8-4fe6-42d6-8d96-35e96d3f5e95" returned: 0 in 0.436s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3fbbd6dc-acf0-486c-8494-c592642b1ab7 tempest-VolumesMetadataTest-1289029353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f0cc04e8-4fe6-42d6-8d96-35e96d3f5e95 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:24 devstack sudo[94715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f0cc04e8-4fe6-42d6-8d96-35e96d3f5e95 Sep 01 02:03:24 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:25 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3fbbd6dc-acf0-486c-8494-c592642b1ab7 tempest-VolumesMetadataTest-1289029353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f0cc04e8-4fe6-42d6-8d96-35e96d3f5e95" returned: 0 in 0.358s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3fbbd6dc-acf0-486c-8494-c592642b1ab7 tempest-VolumesMetadataTest-1289029353 None] Lock "cinder-quobyte-f0cc04e8-4fe6-42d6-8d96-35e96d3f5e95" released by "delete_volume" :: held 0.857s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:25 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-3fbbd6dc-acf0-486c-8494-c592642b1ab7 tempest-VolumesMetadataTest-1289029353 None] Created reservations ['8abbda3f-6289-49d1-b827-879fa4ebfd21', 'b0ca55d0-d5b7-4c95-98c3-59249d45bb3c', '16c3667d-d204-4cef-837c-877cc0b62bff', '9e4b6820-4ed0-4568-8929-9381e1b4a3dc'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:03:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3fbbd6dc-acf0-486c-8494-c592642b1ab7 tempest-VolumesMetadataTest-1289029353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3fbbd6dc-acf0-486c-8494-c592642b1ab7 tempest-VolumesMetadataTest-1289029353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3fbbd6dc-acf0-486c-8494-c592642b1ab7 tempest-VolumesMetadataTest-1289029353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3fbbd6dc-acf0-486c-8494-c592642b1ab7 tempest-VolumesMetadataTest-1289029353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3fbbd6dc-acf0-486c-8494-c592642b1ab7 tempest-VolumesMetadataTest-1289029353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3fbbd6dc-acf0-486c-8494-c592642b1ab7 tempest-VolumesMetadataTest-1289029353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:25 devstack sudo[94720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:03:25 devstack sudo[94720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:25 devstack sudo[94720]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3fbbd6dc-acf0-486c-8494-c592642b1ab7 tempest-VolumesMetadataTest-1289029353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.327s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:25 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-3fbbd6dc-acf0-486c-8494-c592642b1ab7 tempest-VolumesMetadataTest-1289029353 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:03:25 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-3fbbd6dc-acf0-486c-8494-c592642b1ab7 tempest-VolumesMetadataTest-1289029353 None] Deleted volume successfully. Sep 01 02:03:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3fbbd6dc-acf0-486c-8494-c592642b1ab7 tempest-VolumesMetadataTest-1289029353 None] Lock "cinder-f0cc04e8-4fe6-42d6-8d96-35e96d3f5e95-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:31 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:03:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] Flow 'volume_create_manager' (d1ace5a2-adcf-4bd7-a48d-e9caa72682a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4ccce5-fbb4-4330-93b1-dc9868d20a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4ccce5-fbb4-4330-93b1-dc9868d20a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1180331601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c67d8411-1a2b-4a26-ad8a-700552b57d35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e345073f7d4430ca340cdc7306f6037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:32Z,use_quota=True,user_id='23b2ea62318a4ce4992474b332a2950a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc1528f2-015c-4be3-9bb2-ab1a55b694a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc1528f2-015c-4be3-9bb2-ab1a55b694a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c7e249-11bb-4f36-9385-29f9e57179a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c7e249-11bb-4f36-9385-29f9e57179a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c67d8411-1a2b-4a26-ad8a-700552b57d35', 'volume_name': 'volume-c67d8411-1a2b-4a26-ad8a-700552b57d35', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168fe288-3e13-46c5-9fdc-df0dda99fd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168fe288-3e13-46c5-9fdc-df0dda99fd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (052f14b2-6354-40bf-a764-ac75dcf32139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:31 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] Volume c67d8411-1a2b-4a26-ad8a-700552b57d35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c67d8411-1a2b-4a26-ad8a-700552b57d35', 'volume_size': 1} Sep 01 02:03:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:31 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1180331601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c67d8411-1a2b-4a26-ad8a-700552b57d35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e345073f7d4430ca340cdc7306f6037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:32Z,use_quota=True,user_id='23b2ea62318a4ce4992474b332a2950a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:03:31 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] Creating volume c67d8411-1a2b-4a26-ad8a-700552b57d35 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:03:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:31 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:31 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:31 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:03:31 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:03:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c67d8411-1a2b-4a26-ad8a-700552b57d35 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:31 devstack sudo[94730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c67d8411-1a2b-4a26-ad8a-700552b57d35 1073741824 Sep 01 02:03:31 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:32 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c67d8411-1a2b-4a26-ad8a-700552b57d35 1073741824" returned: 0 in 0.778s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c67d8411-1a2b-4a26-ad8a-700552b57d35 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:32 devstack sudo[94744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c67d8411-1a2b-4a26-ad8a-700552b57d35 Sep 01 02:03:32 devstack sudo[94744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:33 devstack sudo[94744]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c67d8411-1a2b-4a26-ad8a-700552b57d35" returned: 0 in 0.479s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:03:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (052f14b2-6354-40bf-a764-ac75dcf32139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c67d8411-1a2b-4a26-ad8a-700552b57d35', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b3543f-c84e-4ea0-b90b-8f87cfc26774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:33 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] Volume volume-c67d8411-1a2b-4a26-ad8a-700552b57d35 (c67d8411-1a2b-4a26-ad8a-700552b57d35): created successfully Sep 01 02:03:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b3543f-c84e-4ea0-b90b-8f87cfc26774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] Flow 'volume_create_manager' (d1ace5a2-adcf-4bd7-a48d-e9caa72682a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:33 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-3eb2e668-f2b2-466d-b1d7-b2d2af970def tempest-VolumesTransfersV357Test-512843006 None] Created volume successfully. Sep 01 02:03:34 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-82d6b303-e086-4d71-91cd-f6a51ce9c0e0 tempest-VolumesTransfersV357Test-1438606153 None] Transfer volume completed successfully. Sep 01 02:03:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-44851552-1852-4ee7-82dd-d7dfb5c95493 tempest-VolumesTransfersV357Test-2084811664 None] Acquiring lock "cinder-c67d8411-1a2b-4a26-ad8a-700552b57d35-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-44851552-1852-4ee7-82dd-d7dfb5c95493 tempest-VolumesTransfersV357Test-2084811664 None] Lock "cinder-c67d8411-1a2b-4a26-ad8a-700552b57d35-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-44851552-1852-4ee7-82dd-d7dfb5c95493 tempest-VolumesTransfersV357Test-2084811664 None] Acquiring lock "cinder-quobyte-c67d8411-1a2b-4a26-ad8a-700552b57d35" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-44851552-1852-4ee7-82dd-d7dfb5c95493 tempest-VolumesTransfersV357Test-2084811664 None] Lock "cinder-quobyte-c67d8411-1a2b-4a26-ad8a-700552b57d35" acquired by "delete_volume" :: waited 0.019s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:35 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a17265d-d5b6-4450-ac7f-12f785918036]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-44851552-1852-4ee7-82dd-d7dfb5c95493 tempest-VolumesTransfersV357Test-2084811664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c67d8411-1a2b-4a26-ad8a-700552b57d35 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:35 devstack sudo[94771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c67d8411-1a2b-4a26-ad8a-700552b57d35 Sep 01 02:03:35 devstack sudo[94771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:35 devstack sudo[94771]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-44851552-1852-4ee7-82dd-d7dfb5c95493 tempest-VolumesTransfersV357Test-2084811664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c67d8411-1a2b-4a26-ad8a-700552b57d35" returned: 0 in 0.440s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-44851552-1852-4ee7-82dd-d7dfb5c95493 tempest-VolumesTransfersV357Test-2084811664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c67d8411-1a2b-4a26-ad8a-700552b57d35 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:35 devstack sudo[94777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c67d8411-1a2b-4a26-ad8a-700552b57d35 Sep 01 02:03:35 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:36 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-44851552-1852-4ee7-82dd-d7dfb5c95493 tempest-VolumesTransfersV357Test-2084811664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c67d8411-1a2b-4a26-ad8a-700552b57d35" returned: 0 in 0.449s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-44851552-1852-4ee7-82dd-d7dfb5c95493 tempest-VolumesTransfersV357Test-2084811664 None] Lock "cinder-quobyte-c67d8411-1a2b-4a26-ad8a-700552b57d35" released by "delete_volume" :: held 0.945s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:36 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-44851552-1852-4ee7-82dd-d7dfb5c95493 tempest-VolumesTransfersV357Test-2084811664 None] Created reservations ['015d7688-8736-42e2-b731-0b18d7dcd6e2', '9c55aa0c-064d-464a-acce-769ec3c89871', '1b03d752-e929-4756-a326-9391980bd380', '6bbc34f5-c225-4d0e-b2b1-1e97800faed8'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:03:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-44851552-1852-4ee7-82dd-d7dfb5c95493 tempest-VolumesTransfersV357Test-2084811664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-44851552-1852-4ee7-82dd-d7dfb5c95493 tempest-VolumesTransfersV357Test-2084811664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:36 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-44851552-1852-4ee7-82dd-d7dfb5c95493 tempest-VolumesTransfersV357Test-2084811664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:36 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-44851552-1852-4ee7-82dd-d7dfb5c95493 tempest-VolumesTransfersV357Test-2084811664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-44851552-1852-4ee7-82dd-d7dfb5c95493 tempest-VolumesTransfersV357Test-2084811664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-44851552-1852-4ee7-82dd-d7dfb5c95493 tempest-VolumesTransfersV357Test-2084811664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:36 devstack sudo[94782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:03:36 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:36 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-44851552-1852-4ee7-82dd-d7dfb5c95493 tempest-VolumesTransfersV357Test-2084811664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.292s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:36 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-44851552-1852-4ee7-82dd-d7dfb5c95493 tempest-VolumesTransfersV357Test-2084811664 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:03:36 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-44851552-1852-4ee7-82dd-d7dfb5c95493 tempest-VolumesTransfersV357Test-2084811664 None] Deleted volume successfully. Sep 01 02:03:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-44851552-1852-4ee7-82dd-d7dfb5c95493 tempest-VolumesTransfersV357Test-2084811664 None] Lock "cinder-c67d8411-1a2b-4a26-ad8a-700552b57d35-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:38 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:03:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] Flow 'volume_create_manager' (aefb2539-40c4-44b1-9e45-4ddba3999c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d16a01-f95c-4d69-9f1b-0989e5bf854f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d16a01-f95c-4d69-9f1b-0989e5bf854f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1987081529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e00e53-440b-47b1-81e9-a28ce792f4e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e345073f7d4430ca340cdc7306f6037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:38Z,use_quota=True,user_id='23b2ea62318a4ce4992474b332a2950a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45003c98-52ff-427c-8082-658f6590c255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45003c98-52ff-427c-8082-658f6590c255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c44ad462-f2c9-4698-ac0d-8bd8599917fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c44ad462-f2c9-4698-ac0d-8bd8599917fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9e00e53-440b-47b1-81e9-a28ce792f4e6', 'volume_name': 'volume-b9e00e53-440b-47b1-81e9-a28ce792f4e6', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b043a42e-c4a5-4d69-b019-2364a84321e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b043a42e-c4a5-4d69-b019-2364a84321e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51440bd4-f48e-48e2-af8f-42ff14b0d33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:38 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] Volume b9e00e53-440b-47b1-81e9-a28ce792f4e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9e00e53-440b-47b1-81e9-a28ce792f4e6', 'volume_size': 1} Sep 01 02:03:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:38 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1987081529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e00e53-440b-47b1-81e9-a28ce792f4e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e345073f7d4430ca340cdc7306f6037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:38Z,use_quota=True,user_id='23b2ea62318a4ce4992474b332a2950a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:03:38 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] Creating volume b9e00e53-440b-47b1-81e9-a28ce792f4e6 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:03:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:38 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:38 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:38 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:03:38 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:03:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9e00e53-440b-47b1-81e9-a28ce792f4e6 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:38 devstack sudo[94801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9e00e53-440b-47b1-81e9-a28ce792f4e6 1073741824 Sep 01 02:03:38 devstack sudo[94801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:38 devstack sudo[94801]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9e00e53-440b-47b1-81e9-a28ce792f4e6 1073741824" returned: 0 in 0.509s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9e00e53-440b-47b1-81e9-a28ce792f4e6 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:39 devstack sudo[94808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9e00e53-440b-47b1-81e9-a28ce792f4e6 Sep 01 02:03:39 devstack sudo[94808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:39 devstack sudo[94808]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9e00e53-440b-47b1-81e9-a28ce792f4e6" returned: 0 in 0.451s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:39 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:03:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51440bd4-f48e-48e2-af8f-42ff14b0d33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9e00e53-440b-47b1-81e9-a28ce792f4e6', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a70dbfe-39ef-4336-8a36-30caeb65db9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:39 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] Volume volume-b9e00e53-440b-47b1-81e9-a28ce792f4e6 (b9e00e53-440b-47b1-81e9-a28ce792f4e6): created successfully Sep 01 02:03:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a70dbfe-39ef-4336-8a36-30caeb65db9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] Flow 'volume_create_manager' (aefb2539-40c4-44b1-9e45-4ddba3999c48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:39 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-12d51809-5437-4f3b-8e2e-34f18fb3ec68 tempest-VolumesTransfersV357Test-512843006 None] Created volume successfully. Sep 01 02:03:39 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-b5b1b6dc-3bcc-4062-9dde-a15b8c651764 req-6e0b89f5-fb9a-41b8-8097-e17385bc6f28 tempest-AttachVolumeNegativeTest-545642174 None] Terminate volume connection completed successfully. Sep 01 02:03:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-b5b1b6dc-3bcc-4062-9dde-a15b8c651764 req-6e0b89f5-fb9a-41b8-8097-e17385bc6f28 tempest-AttachVolumeNegativeTest-545642174 None] Deleting attachment 639069d9-fd28-4264-ba44-0bca6926ed37. {{(pid=87128) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:03:41 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6f6dd190-46e1-4768-b089-5c31bf50d8cd tempest-VolumesTransfersV357Test-2084811664 None] Acquiring lock "cinder-b9e00e53-440b-47b1-81e9-a28ce792f4e6-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:41 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6f6dd190-46e1-4768-b089-5c31bf50d8cd tempest-VolumesTransfersV357Test-2084811664 None] Lock "cinder-b9e00e53-440b-47b1-81e9-a28ce792f4e6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:41 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6f6dd190-46e1-4768-b089-5c31bf50d8cd tempest-VolumesTransfersV357Test-2084811664 None] Acquiring lock "cinder-quobyte-b9e00e53-440b-47b1-81e9-a28ce792f4e6" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:41 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6f6dd190-46e1-4768-b089-5c31bf50d8cd tempest-VolumesTransfersV357Test-2084811664 None] Lock "cinder-quobyte-b9e00e53-440b-47b1-81e9-a28ce792f4e6" acquired by "delete_volume" :: waited 0.019s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:41 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec2a4f8-18e8-43c7-adc7-41ba8c43a261]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6f6dd190-46e1-4768-b089-5c31bf50d8cd tempest-VolumesTransfersV357Test-2084811664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9e00e53-440b-47b1-81e9-a28ce792f4e6 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:41 devstack sudo[94837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9e00e53-440b-47b1-81e9-a28ce792f4e6 Sep 01 02:03:41 devstack sudo[94837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:41 devstack sudo[94837]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6f6dd190-46e1-4768-b089-5c31bf50d8cd tempest-VolumesTransfersV357Test-2084811664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9e00e53-440b-47b1-81e9-a28ce792f4e6" returned: 0 in 0.534s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6f6dd190-46e1-4768-b089-5c31bf50d8cd tempest-VolumesTransfersV357Test-2084811664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9e00e53-440b-47b1-81e9-a28ce792f4e6 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:42 devstack sudo[94847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9e00e53-440b-47b1-81e9-a28ce792f4e6 Sep 01 02:03:42 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:42 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-82be3d59-ae84-4919-8bc0-41b4b9856346 req-ddd7dc27-4115-4528-ac90-f6f5e2a1e2ad tempest-AttachVolumeTestJSON-602593005 None] Terminate volume connection completed successfully. Sep 01 02:03:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-82be3d59-ae84-4919-8bc0-41b4b9856346 req-ddd7dc27-4115-4528-ac90-f6f5e2a1e2ad tempest-AttachVolumeTestJSON-602593005 None] Deleting attachment f60b5c41-0943-4134-83c0-be4a0f4fd615. {{(pid=87128) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:03:42 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6f6dd190-46e1-4768-b089-5c31bf50d8cd tempest-VolumesTransfersV357Test-2084811664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9e00e53-440b-47b1-81e9-a28ce792f4e6" returned: 0 in 0.509s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:42 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6f6dd190-46e1-4768-b089-5c31bf50d8cd tempest-VolumesTransfersV357Test-2084811664 None] Lock "cinder-quobyte-b9e00e53-440b-47b1-81e9-a28ce792f4e6" released by "delete_volume" :: held 1.124s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:42 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-6f6dd190-46e1-4768-b089-5c31bf50d8cd tempest-VolumesTransfersV357Test-2084811664 None] Created reservations ['059ec639-45bd-4b62-aec9-f193423fdd98', '3a8966a9-2677-4f02-9834-3a64d60d3af3', '06c8491c-2ac3-4490-96f0-4f652cc1b4b4', '07085a66-0510-4304-aba5-2a5a6b54667c'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:03:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6f6dd190-46e1-4768-b089-5c31bf50d8cd tempest-VolumesTransfersV357Test-2084811664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6f6dd190-46e1-4768-b089-5c31bf50d8cd tempest-VolumesTransfersV357Test-2084811664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-6f6dd190-46e1-4768-b089-5c31bf50d8cd tempest-VolumesTransfersV357Test-2084811664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-6f6dd190-46e1-4768-b089-5c31bf50d8cd tempest-VolumesTransfersV357Test-2084811664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6f6dd190-46e1-4768-b089-5c31bf50d8cd tempest-VolumesTransfersV357Test-2084811664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6f6dd190-46e1-4768-b089-5c31bf50d8cd tempest-VolumesTransfersV357Test-2084811664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:42 devstack sudo[94853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:03:42 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:42 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6f6dd190-46e1-4768-b089-5c31bf50d8cd tempest-VolumesTransfersV357Test-2084811664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.305s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:42 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-6f6dd190-46e1-4768-b089-5c31bf50d8cd tempest-VolumesTransfersV357Test-2084811664 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:03:42 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-6f6dd190-46e1-4768-b089-5c31bf50d8cd tempest-VolumesTransfersV357Test-2084811664 None] Deleted volume successfully. Sep 01 02:03:43 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6f6dd190-46e1-4768-b089-5c31bf50d8cd tempest-VolumesTransfersV357Test-2084811664 None] Lock "cinder-b9e00e53-440b-47b1-81e9-a28ce792f4e6-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:52 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=37,cinder:INSERT=12,cinder:UPDATE=45,cinder:DELETE=3 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:03:52 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:UPDATE=34,cinder:SELECT=23,cinder:INSERT=8,cinder:DELETE=4 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:03:54 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:03:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] Flow 'volume_create_manager' (d75f3ccd-fe91-4456-af46-d8896bc55f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6f7b7c8-ba82-460d-acb4-b39c172be6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6f7b7c8-ba82-460d-acb4-b39c172be6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1131507024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8681eed0-c5e0-467b-85af-b2809b4d8547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85abd95fe9da4129a6cc4b2a728eafdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:54Z,use_quota=True,user_id='954dc08defe241429b776e98e945bad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89674329-767b-499b-84c0-922bb87da4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89674329-767b-499b-84c0-922bb87da4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e14b4da-b750-4e86-860d-0dcb5ba891f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e14b4da-b750-4e86-860d-0dcb5ba891f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8681eed0-c5e0-467b-85af-b2809b4d8547', 'volume_name': 'volume-8681eed0-c5e0-467b-85af-b2809b4d8547', 'volume_size': 2}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6caf6945-9e0e-40c0-be59-1eb5f07f4358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6caf6945-9e0e-40c0-be59-1eb5f07f4358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07cd85dd-edae-430c-a875-0644a7e8a2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:54 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] Volume 8681eed0-c5e0-467b-85af-b2809b4d8547: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8681eed0-c5e0-467b-85af-b2809b4d8547', 'volume_size': 2} Sep 01 02:03:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1131507024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8681eed0-c5e0-467b-85af-b2809b4d8547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85abd95fe9da4129a6cc4b2a728eafdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:54Z,use_quota=True,user_id='954dc08defe241429b776e98e945bad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:03:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] Creating volume 8681eed0-c5e0-467b-85af-b2809b4d8547 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:03:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:03:54 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:03:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8681eed0-c5e0-467b-85af-b2809b4d8547 2147483648 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:54 devstack sudo[95004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8681eed0-c5e0-467b-85af-b2809b4d8547 2147483648 Sep 01 02:03:54 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:55 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8681eed0-c5e0-467b-85af-b2809b4d8547 2147483648" returned: 0 in 0.793s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8681eed0-c5e0-467b-85af-b2809b4d8547 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:55 devstack sudo[95040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8681eed0-c5e0-467b-85af-b2809b4d8547 Sep 01 02:03:55 devstack sudo[95040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:56 devstack sudo[95040]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8681eed0-c5e0-467b-85af-b2809b4d8547" returned: 0 in 0.798s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:56 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:03:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.910s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07cd85dd-edae-430c-a875-0644a7e8a2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8681eed0-c5e0-467b-85af-b2809b4d8547', 'volume_size': 2}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac626bf-cda1-4279-a1e1-238005637515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:56 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] Volume volume-8681eed0-c5e0-467b-85af-b2809b4d8547 (8681eed0-c5e0-467b-85af-b2809b4d8547): created successfully Sep 01 02:03:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac626bf-cda1-4279-a1e1-238005637515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] Flow 'volume_create_manager' (d75f3ccd-fe91-4456-af46-d8896bc55f52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:56 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-46741658-d118-4634-941f-34b0a73b55db tempest-VolumesCloneNegativeTest-153923218 None] Created volume successfully. Sep 01 02:03:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0ae1d152-a4d8-4e23-827c-24237dabe608 tempest-VolumesCloneNegativeTest-153923218 None] Acquiring lock "cinder-8681eed0-c5e0-467b-85af-b2809b4d8547-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0ae1d152-a4d8-4e23-827c-24237dabe608 tempest-VolumesCloneNegativeTest-153923218 None] Lock "cinder-8681eed0-c5e0-467b-85af-b2809b4d8547-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:58 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0ae1d152-a4d8-4e23-827c-24237dabe608 tempest-VolumesCloneNegativeTest-153923218 None] Acquiring lock "cinder-quobyte-8681eed0-c5e0-467b-85af-b2809b4d8547" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:58 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0ae1d152-a4d8-4e23-827c-24237dabe608 tempest-VolumesCloneNegativeTest-153923218 None] Lock "cinder-quobyte-8681eed0-c5e0-467b-85af-b2809b4d8547" acquired by "delete_volume" :: waited 0.068s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:58 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1b0906-0e20-47c8-aa2d-f96290c0c08c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0ae1d152-a4d8-4e23-827c-24237dabe608 tempest-VolumesCloneNegativeTest-153923218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8681eed0-c5e0-467b-85af-b2809b4d8547 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:58 devstack sudo[95087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8681eed0-c5e0-467b-85af-b2809b4d8547 Sep 01 02:03:58 devstack sudo[95087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:59 devstack sudo[95087]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0ae1d152-a4d8-4e23-827c-24237dabe608 tempest-VolumesCloneNegativeTest-153923218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8681eed0-c5e0-467b-85af-b2809b4d8547" returned: 0 in 0.947s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0ae1d152-a4d8-4e23-827c-24237dabe608 tempest-VolumesCloneNegativeTest-153923218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8681eed0-c5e0-467b-85af-b2809b4d8547 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:59 devstack sudo[95106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8681eed0-c5e0-467b-85af-b2809b4d8547 Sep 01 02:03:59 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:59 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0ae1d152-a4d8-4e23-827c-24237dabe608 tempest-VolumesCloneNegativeTest-153923218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8681eed0-c5e0-467b-85af-b2809b4d8547" returned: 0 in 0.771s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:59 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0ae1d152-a4d8-4e23-827c-24237dabe608 tempest-VolumesCloneNegativeTest-153923218 None] Lock "cinder-quobyte-8681eed0-c5e0-467b-85af-b2809b4d8547" released by "delete_volume" :: held 1.895s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:00 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-0ae1d152-a4d8-4e23-827c-24237dabe608 tempest-VolumesCloneNegativeTest-153923218 None] Created reservations ['cc2e2337-a901-4201-ac5c-a770ecc1bfef', '31f257cc-f931-4aae-aade-f33786f5ba20', 'd7fe14ac-e962-40d3-a6bc-87be350c68d4', 'ab1f61c9-0d63-47a0-a336-29e0080c674c'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0ae1d152-a4d8-4e23-827c-24237dabe608 tempest-VolumesCloneNegativeTest-153923218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0ae1d152-a4d8-4e23-827c-24237dabe608 tempest-VolumesCloneNegativeTest-153923218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:00 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0ae1d152-a4d8-4e23-827c-24237dabe608 tempest-VolumesCloneNegativeTest-153923218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:00 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0ae1d152-a4d8-4e23-827c-24237dabe608 tempest-VolumesCloneNegativeTest-153923218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0ae1d152-a4d8-4e23-827c-24237dabe608 tempest-VolumesCloneNegativeTest-153923218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0ae1d152-a4d8-4e23-827c-24237dabe608 tempest-VolumesCloneNegativeTest-153923218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:00 devstack sudo[95109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:04:00 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:00 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0ae1d152-a4d8-4e23-827c-24237dabe608 tempest-VolumesCloneNegativeTest-153923218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.790s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:01 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-0ae1d152-a4d8-4e23-827c-24237dabe608 tempest-VolumesCloneNegativeTest-153923218 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:01 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-0ae1d152-a4d8-4e23-827c-24237dabe608 tempest-VolumesCloneNegativeTest-153923218 None] Deleted volume successfully. Sep 01 02:04:01 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0ae1d152-a4d8-4e23-827c-24237dabe608 tempest-VolumesCloneNegativeTest-153923218 None] Lock "cinder-8681eed0-c5e0-467b-85af-b2809b4d8547-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:03 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:04:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] Flow 'volume_create_manager' (37d62ffd-b249-49e7-b743-d8b35c33ef4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (227b59e0-2399-4c59-a87f-a0a20054d387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (227b59e0-2399-4c59-a87f-a0a20054d387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-738021411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=264c87a9-4e19-4b96-bfaa-d7d9384e0cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbf80acfcc374f20b86de24c3e285484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:04Z,use_quota=True,user_id='32f638994efb42f48169b6def7679c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcebbac9-3154-4fc3-86d3-2591b7df66ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcebbac9-3154-4fc3-86d3-2591b7df66ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2e07644-fbfa-4cf5-9a19-e99f55ac561b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2e07644-fbfa-4cf5-9a19-e99f55ac561b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '264c87a9-4e19-4b96-bfaa-d7d9384e0cca', 'volume_name': 'volume-264c87a9-4e19-4b96-bfaa-d7d9384e0cca', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa32b32-adeb-493c-a167-04d47559bab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa32b32-adeb-493c-a167-04d47559bab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (421b424d-714f-454d-937d-ab2a7901cea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:03 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] Volume 264c87a9-4e19-4b96-bfaa-d7d9384e0cca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-264c87a9-4e19-4b96-bfaa-d7d9384e0cca', 'volume_size': 1} Sep 01 02:04:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:03 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-738021411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=264c87a9-4e19-4b96-bfaa-d7d9384e0cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbf80acfcc374f20b86de24c3e285484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:04Z,use_quota=True,user_id='32f638994efb42f48169b6def7679c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:04:03 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] Creating volume 264c87a9-4e19-4b96-bfaa-d7d9384e0cca {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:04:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:03 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:04 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:04 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:04:04 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:04:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-264c87a9-4e19-4b96-bfaa-d7d9384e0cca 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:04 devstack sudo[95170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-264c87a9-4e19-4b96-bfaa-d7d9384e0cca 1073741824 Sep 01 02:04:04 devstack sudo[95170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:05 devstack sudo[95170]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-264c87a9-4e19-4b96-bfaa-d7d9384e0cca 1073741824" returned: 0 in 1.145s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-264c87a9-4e19-4b96-bfaa-d7d9384e0cca {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:05 devstack sudo[95185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-264c87a9-4e19-4b96-bfaa-d7d9384e0cca Sep 01 02:04:05 devstack sudo[95185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:05 devstack sudo[95185]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-264c87a9-4e19-4b96-bfaa-d7d9384e0cca" returned: 0 in 0.577s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:05 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (421b424d-714f-454d-937d-ab2a7901cea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-264c87a9-4e19-4b96-bfaa-d7d9384e0cca', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0981b5bf-07ac-4c4a-8381-aff093d47995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:05 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] Volume volume-264c87a9-4e19-4b96-bfaa-d7d9384e0cca (264c87a9-4e19-4b96-bfaa-d7d9384e0cca): created successfully Sep 01 02:04:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0981b5bf-07ac-4c4a-8381-aff093d47995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] Flow 'volume_create_manager' (37d62ffd-b249-49e7-b743-d8b35c33ef4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:05 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-5f6d2fe3-ee4e-49ce-a8c4-f021f7bfce4f tempest-TestMinimumBasicScenario-1690085929 None] Created volume successfully. Sep 01 02:04:08 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:04:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] Flow 'volume_create_manager' (d20e1e2d-76d6-4933-9aa6-54447275f227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (493ea1e2-382c-4cfd-9ae1-241a39821c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (493ea1e2-382c-4cfd-9ae1-241a39821c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-444185536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8819adc6-e151-4ea8-be65-328f0f0739c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5792fcd7a5214d9f83fccc420662bd87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:08Z,use_quota=True,user_id='82d5e520c7e54e628457c3d27bd08e28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c4ba1b2-8121-4fc9-80ed-c6763ede9f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c4ba1b2-8121-4fc9-80ed-c6763ede9f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa27444-6121-429b-818e-359eb8d2034e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa27444-6121-429b-818e-359eb8d2034e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8819adc6-e151-4ea8-be65-328f0f0739c0', 'volume_name': 'volume-8819adc6-e151-4ea8-be65-328f0f0739c0', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe8a568a-77f6-43eb-b594-174417872da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe8a568a-77f6-43eb-b594-174417872da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e1495f-8f93-4a64-ac9c-191ea946fee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:08 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] Volume 8819adc6-e151-4ea8-be65-328f0f0739c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8819adc6-e151-4ea8-be65-328f0f0739c0', 'volume_size': 1} Sep 01 02:04:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-444185536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8819adc6-e151-4ea8-be65-328f0f0739c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5792fcd7a5214d9f83fccc420662bd87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:08Z,use_quota=True,user_id='82d5e520c7e54e628457c3d27bd08e28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:04:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] Creating volume 8819adc6-e151-4ea8-be65-328f0f0739c0 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:04:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:04:08 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:04:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8819adc6-e151-4ea8-be65-328f0f0739c0 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:08 devstack sudo[95196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8819adc6-e151-4ea8-be65-328f0f0739c0 1073741824 Sep 01 02:04:08 devstack sudo[95196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-3ea4f191-db1d-4917-a47d-0d3684f44772 req-ca7c187f-8fc9-493e-88d1-88e29d8bbe7a tempest-TestMinimumBasicScenario-1690085929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:09 devstack sudo[95196]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8819adc6-e151-4ea8-be65-328f0f0739c0 1073741824" returned: 0 in 0.832s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8819adc6-e151-4ea8-be65-328f0f0739c0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:09 devstack sudo[95212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8819adc6-e151-4ea8-be65-328f0f0739c0 Sep 01 02:04:09 devstack sudo[95212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:09 devstack sudo[95212]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8819adc6-e151-4ea8-be65-328f0f0739c0" returned: 0 in 0.286s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:09 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-3ea4f191-db1d-4917-a47d-0d3684f44772 req-ca7c187f-8fc9-493e-88d1-88e29d8bbe7a tempest-TestMinimumBasicScenario-1690085929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.384s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e1495f-8f93-4a64-ac9c-191ea946fee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8819adc6-e151-4ea8-be65-328f0f0739c0', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84da2cb6-27ce-4d7f-bd52-331e01159cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-3ea4f191-db1d-4917-a47d-0d3684f44772 req-ca7c187f-8fc9-493e-88d1-88e29d8bbe7a tempest-TestMinimumBasicScenario-1690085929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:09 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] Volume volume-8819adc6-e151-4ea8-be65-328f0f0739c0 (8819adc6-e151-4ea8-be65-328f0f0739c0): created successfully Sep 01 02:04:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84da2cb6-27ce-4d7f-bd52-331e01159cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] Flow 'volume_create_manager' (d20e1e2d-76d6-4933-9aa6-54447275f227) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:09 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-3fafeed2-844f-4899-8ab7-976dbc84fb59 tempest-VolumesListTestJSON-1919245024 None] Created volume successfully. Sep 01 02:04:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-3ea4f191-db1d-4917-a47d-0d3684f44772 req-ca7c187f-8fc9-493e-88d1-88e29d8bbe7a tempest-TestMinimumBasicScenario-1690085929 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb', 'name': 'volume-264c87a9-4e19-4b96-bfaa-d7d9384e0cca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '49a6719b-d553-4e81-ac63-d328a0456ea0', 'enforce_multipath': True} {{(pid=87128) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:04:10 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-3ea4f191-db1d-4917-a47d-0d3684f44772 req-ca7c187f-8fc9-493e-88d1-88e29d8bbe7a tempest-TestMinimumBasicScenario-1690085929 None] attachment_update completed successfully. Sep 01 02:04:11 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:04:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] Flow 'volume_create_manager' (e603ef1f-389a-4894-9259-f4cf19be9bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26d1c2a-6d7a-483e-92bf-7fa6054be661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26d1c2a-6d7a-483e-92bf-7fa6054be661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-528303566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=becb3042-7174-4bd7-bc4e-39f665341740,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5792fcd7a5214d9f83fccc420662bd87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:12Z,use_quota=True,user_id='82d5e520c7e54e628457c3d27bd08e28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3094a4c-ef02-41d4-b47b-ba815a80303d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3094a4c-ef02-41d4-b47b-ba815a80303d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf80cc40-330f-4f68-87c9-25061b994503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf80cc40-330f-4f68-87c9-25061b994503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'becb3042-7174-4bd7-bc4e-39f665341740', 'volume_name': 'volume-becb3042-7174-4bd7-bc4e-39f665341740', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efbc362e-0914-4773-b842-250da7175efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efbc362e-0914-4773-b842-250da7175efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e33d32ae-2fe2-4fcf-9c0c-21fa265a873e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:11 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] Volume becb3042-7174-4bd7-bc4e-39f665341740: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-becb3042-7174-4bd7-bc4e-39f665341740', 'volume_size': 1} Sep 01 02:04:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:11 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-528303566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=becb3042-7174-4bd7-bc4e-39f665341740,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5792fcd7a5214d9f83fccc420662bd87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:12Z,use_quota=True,user_id='82d5e520c7e54e628457c3d27bd08e28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:04:11 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] Creating volume becb3042-7174-4bd7-bc4e-39f665341740 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:04:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:11 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:11 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:11 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:04:11 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:04:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-becb3042-7174-4bd7-bc4e-39f665341740 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:11 devstack sudo[95600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-becb3042-7174-4bd7-bc4e-39f665341740 1073741824 Sep 01 02:04:11 devstack sudo[95600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:12 devstack sudo[95600]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-becb3042-7174-4bd7-bc4e-39f665341740 1073741824" returned: 0 in 0.476s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-becb3042-7174-4bd7-bc4e-39f665341740 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:12 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-becb3042-7174-4bd7-bc4e-39f665341740 Sep 01 02:04:12 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:12 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-becb3042-7174-4bd7-bc4e-39f665341740" returned: 0 in 0.343s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:12 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e33d32ae-2fe2-4fcf-9c0c-21fa265a873e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-becb3042-7174-4bd7-bc4e-39f665341740', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee023711-abd9-4a92-a7cd-90b24b53f32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:12 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] Volume volume-becb3042-7174-4bd7-bc4e-39f665341740 (becb3042-7174-4bd7-bc4e-39f665341740): created successfully Sep 01 02:04:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee023711-abd9-4a92-a7cd-90b24b53f32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] Flow 'volume_create_manager' (e603ef1f-389a-4894-9259-f4cf19be9bef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:12 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-32279e3a-f58c-48ef-94ed-8fedf7abb2d6 tempest-VolumesListTestJSON-1919245024 None] Created volume successfully. Sep 01 02:04:14 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:04:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] Flow 'volume_create_manager' (7f7dd109-c4a4-4d27-a93d-838dbf3b41ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a16f520-d5cd-4fc5-bafe-4c018cb67dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a16f520-d5cd-4fc5-bafe-4c018cb67dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-239673931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c1682b6-1ec5-4833-adb3-8de7425c5815,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5792fcd7a5214d9f83fccc420662bd87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:15Z,use_quota=True,user_id='82d5e520c7e54e628457c3d27bd08e28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caaf684c-b27d-4cea-bdc1-64e2ea32051e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caaf684c-b27d-4cea-bdc1-64e2ea32051e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0676a4f-ad3b-4c09-9a6f-9400a2013b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0676a4f-ad3b-4c09-9a6f-9400a2013b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c1682b6-1ec5-4833-adb3-8de7425c5815', 'volume_name': 'volume-3c1682b6-1ec5-4833-adb3-8de7425c5815', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948d57e2-3a54-4fc5-9b6d-6fd3de2c7aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948d57e2-3a54-4fc5-9b6d-6fd3de2c7aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d691c2d-0223-49c0-a5a2-bfa7ed5a6ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:15 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] Volume 3c1682b6-1ec5-4833-adb3-8de7425c5815: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c1682b6-1ec5-4833-adb3-8de7425c5815', 'volume_size': 1} Sep 01 02:04:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:15 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-239673931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c1682b6-1ec5-4833-adb3-8de7425c5815,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5792fcd7a5214d9f83fccc420662bd87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:15Z,use_quota=True,user_id='82d5e520c7e54e628457c3d27bd08e28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:04:15 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] Creating volume 3c1682b6-1ec5-4833-adb3-8de7425c5815 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:04:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:15 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:15 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:15 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:04:15 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:04:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3c1682b6-1ec5-4833-adb3-8de7425c5815 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:15 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3c1682b6-1ec5-4833-adb3-8de7425c5815 1073741824 Sep 01 02:04:15 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:15 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3c1682b6-1ec5-4833-adb3-8de7425c5815 1073741824" returned: 0 in 0.820s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3c1682b6-1ec5-4833-adb3-8de7425c5815 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:15 devstack sudo[95669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3c1682b6-1ec5-4833-adb3-8de7425c5815 Sep 01 02:04:15 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:16 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3c1682b6-1ec5-4833-adb3-8de7425c5815" returned: 0 in 0.277s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d691c2d-0223-49c0-a5a2-bfa7ed5a6ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c1682b6-1ec5-4833-adb3-8de7425c5815', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97fcacbe-a21c-44c9-9e82-34b58e355391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:16 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] Volume volume-3c1682b6-1ec5-4833-adb3-8de7425c5815 (3c1682b6-1ec5-4833-adb3-8de7425c5815): created successfully Sep 01 02:04:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97fcacbe-a21c-44c9-9e82-34b58e355391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] Flow 'volume_create_manager' (7f7dd109-c4a4-4d27-a93d-838dbf3b41ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:16 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-5aa804b1-2855-466a-9b4d-73718f8fb14a tempest-VolumesListTestJSON-1919245024 None] Created volume successfully. Sep 01 02:04:16 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:04:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:17 devstack sudo[95673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:04:17 devstack sudo[95673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:17 devstack sudo[95673]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.473s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:17 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:17 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager._thread_info {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:04:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread count: 28 {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:04:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread info: [<_MainThread(MainThread, started 128688016527488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:04:20 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-672e9afe-4d13-4ceb-bff0-93ce00d00f08 tempest-VolumesListTestJSON-1919245024 None] Acquiring lock "cinder-3c1682b6-1ec5-4833-adb3-8de7425c5815-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:20 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-672e9afe-4d13-4ceb-bff0-93ce00d00f08 tempest-VolumesListTestJSON-1919245024 None] Lock "cinder-3c1682b6-1ec5-4833-adb3-8de7425c5815-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:20 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-672e9afe-4d13-4ceb-bff0-93ce00d00f08 tempest-VolumesListTestJSON-1919245024 None] Acquiring lock "cinder-quobyte-3c1682b6-1ec5-4833-adb3-8de7425c5815" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:20 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-672e9afe-4d13-4ceb-bff0-93ce00d00f08 tempest-VolumesListTestJSON-1919245024 None] Lock "cinder-quobyte-3c1682b6-1ec5-4833-adb3-8de7425c5815" acquired by "delete_volume" :: waited 0.021s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:20 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ae0a2c-1b97-45ba-a8d8-0744e1c748df]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-672e9afe-4d13-4ceb-bff0-93ce00d00f08 tempest-VolumesListTestJSON-1919245024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3c1682b6-1ec5-4833-adb3-8de7425c5815 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:20 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3c1682b6-1ec5-4833-adb3-8de7425c5815 Sep 01 02:04:20 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:21 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-672e9afe-4d13-4ceb-bff0-93ce00d00f08 tempest-VolumesListTestJSON-1919245024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3c1682b6-1ec5-4833-adb3-8de7425c5815" returned: 0 in 0.466s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-672e9afe-4d13-4ceb-bff0-93ce00d00f08 tempest-VolumesListTestJSON-1919245024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3c1682b6-1ec5-4833-adb3-8de7425c5815 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:21 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3c1682b6-1ec5-4833-adb3-8de7425c5815 Sep 01 02:04:21 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:21 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-672e9afe-4d13-4ceb-bff0-93ce00d00f08 tempest-VolumesListTestJSON-1919245024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3c1682b6-1ec5-4833-adb3-8de7425c5815" returned: 0 in 0.345s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:21 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-672e9afe-4d13-4ceb-bff0-93ce00d00f08 tempest-VolumesListTestJSON-1919245024 None] Lock "cinder-quobyte-3c1682b6-1ec5-4833-adb3-8de7425c5815" released by "delete_volume" :: held 0.861s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:21 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-672e9afe-4d13-4ceb-bff0-93ce00d00f08 tempest-VolumesListTestJSON-1919245024 None] Created reservations ['881159c8-fd75-4b8d-8600-3205ca590608', '200a7bf1-9d88-4bc9-9ce3-eae2adb0e407', '53896d55-cc48-458e-a986-d642ebcecc05', '0a281a20-3081-401f-8e14-9591988f0f4d'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-672e9afe-4d13-4ceb-bff0-93ce00d00f08 tempest-VolumesListTestJSON-1919245024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-672e9afe-4d13-4ceb-bff0-93ce00d00f08 tempest-VolumesListTestJSON-1919245024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-672e9afe-4d13-4ceb-bff0-93ce00d00f08 tempest-VolumesListTestJSON-1919245024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-672e9afe-4d13-4ceb-bff0-93ce00d00f08 tempest-VolumesListTestJSON-1919245024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-672e9afe-4d13-4ceb-bff0-93ce00d00f08 tempest-VolumesListTestJSON-1919245024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-672e9afe-4d13-4ceb-bff0-93ce00d00f08 tempest-VolumesListTestJSON-1919245024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:21 devstack sudo[95742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:04:21 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:21 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8151b89b-2ca5-4b38-ba9a-363de49c405b tempest-VolumesListTestJSON-1919245024 None] Acquiring lock "cinder-becb3042-7174-4bd7-bc4e-39f665341740-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:21 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8151b89b-2ca5-4b38-ba9a-363de49c405b tempest-VolumesListTestJSON-1919245024 None] Lock "cinder-becb3042-7174-4bd7-bc4e-39f665341740-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:21 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8151b89b-2ca5-4b38-ba9a-363de49c405b tempest-VolumesListTestJSON-1919245024 None] Acquiring lock "cinder-quobyte-becb3042-7174-4bd7-bc4e-39f665341740" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:22 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8151b89b-2ca5-4b38-ba9a-363de49c405b tempest-VolumesListTestJSON-1919245024 None] Lock "cinder-quobyte-becb3042-7174-4bd7-bc4e-39f665341740" acquired by "delete_volume" :: waited 0.038s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:22 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6e4db9-43ed-4643-a853-3c2c9aeb4e52]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8151b89b-2ca5-4b38-ba9a-363de49c405b tempest-VolumesListTestJSON-1919245024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-becb3042-7174-4bd7-bc4e-39f665341740 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:22 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-672e9afe-4d13-4ceb-bff0-93ce00d00f08 tempest-VolumesListTestJSON-1919245024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.500s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:22 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-672e9afe-4d13-4ceb-bff0-93ce00d00f08 tempest-VolumesListTestJSON-1919245024 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:22 devstack sudo[95744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-becb3042-7174-4bd7-bc4e-39f665341740 Sep 01 02:04:22 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:22 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-672e9afe-4d13-4ceb-bff0-93ce00d00f08 tempest-VolumesListTestJSON-1919245024 None] Deleted volume successfully. Sep 01 02:04:22 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-672e9afe-4d13-4ceb-bff0-93ce00d00f08 tempest-VolumesListTestJSON-1919245024 None] Lock "cinder-3c1682b6-1ec5-4833-adb3-8de7425c5815-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:22 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8151b89b-2ca5-4b38-ba9a-363de49c405b tempest-VolumesListTestJSON-1919245024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-becb3042-7174-4bd7-bc4e-39f665341740" returned: 0 in 0.575s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8151b89b-2ca5-4b38-ba9a-363de49c405b tempest-VolumesListTestJSON-1919245024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-becb3042-7174-4bd7-bc4e-39f665341740 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:22 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-becb3042-7174-4bd7-bc4e-39f665341740 Sep 01 02:04:22 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:22 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8151b89b-2ca5-4b38-ba9a-363de49c405b tempest-VolumesListTestJSON-1919245024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-becb3042-7174-4bd7-bc4e-39f665341740" returned: 0 in 0.329s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:22 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8151b89b-2ca5-4b38-ba9a-363de49c405b tempest-VolumesListTestJSON-1919245024 None] Lock "cinder-quobyte-becb3042-7174-4bd7-bc4e-39f665341740" released by "delete_volume" :: held 0.978s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:23 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-8151b89b-2ca5-4b38-ba9a-363de49c405b tempest-VolumesListTestJSON-1919245024 None] Created reservations ['ad011e64-5147-4cd2-b1db-f392ee61cab6', '7eb8886e-44bd-49c3-a3aa-54100e33a8c7', 'e495bfd7-ca1f-48e1-82a5-7ac24d0dc1f9', '2ab4638d-fcc5-4e5e-ac48-5728f621a654'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8151b89b-2ca5-4b38-ba9a-363de49c405b tempest-VolumesListTestJSON-1919245024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8151b89b-2ca5-4b38-ba9a-363de49c405b tempest-VolumesListTestJSON-1919245024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:23 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8151b89b-2ca5-4b38-ba9a-363de49c405b tempest-VolumesListTestJSON-1919245024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:23 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8151b89b-2ca5-4b38-ba9a-363de49c405b tempest-VolumesListTestJSON-1919245024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8151b89b-2ca5-4b38-ba9a-363de49c405b tempest-VolumesListTestJSON-1919245024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8151b89b-2ca5-4b38-ba9a-363de49c405b tempest-VolumesListTestJSON-1919245024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:23 devstack sudo[95755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:04:23 devstack sudo[95755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:23 devstack sudo[95755]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8151b89b-2ca5-4b38-ba9a-363de49c405b tempest-VolumesListTestJSON-1919245024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.397s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:23 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-8151b89b-2ca5-4b38-ba9a-363de49c405b tempest-VolumesListTestJSON-1919245024 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:23 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-8151b89b-2ca5-4b38-ba9a-363de49c405b tempest-VolumesListTestJSON-1919245024 None] Deleted volume successfully. Sep 01 02:04:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8151b89b-2ca5-4b38-ba9a-363de49c405b tempest-VolumesListTestJSON-1919245024 None] Lock "cinder-becb3042-7174-4bd7-bc4e-39f665341740-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1ad50c94-3a96-4057-8459-7d412179094b tempest-VolumesListTestJSON-1919245024 None] Acquiring lock "cinder-8819adc6-e151-4ea8-be65-328f0f0739c0-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1ad50c94-3a96-4057-8459-7d412179094b tempest-VolumesListTestJSON-1919245024 None] Lock "cinder-8819adc6-e151-4ea8-be65-328f0f0739c0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1ad50c94-3a96-4057-8459-7d412179094b tempest-VolumesListTestJSON-1919245024 None] Acquiring lock "cinder-quobyte-8819adc6-e151-4ea8-be65-328f0f0739c0" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1ad50c94-3a96-4057-8459-7d412179094b tempest-VolumesListTestJSON-1919245024 None] Lock "cinder-quobyte-8819adc6-e151-4ea8-be65-328f0f0739c0" acquired by "delete_volume" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:24 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[079acc64-2caa-4fab-9250-905757189cd0]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1ad50c94-3a96-4057-8459-7d412179094b tempest-VolumesListTestJSON-1919245024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8819adc6-e151-4ea8-be65-328f0f0739c0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:24 devstack sudo[95761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8819adc6-e151-4ea8-be65-328f0f0739c0 Sep 01 02:04:24 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:24 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1ad50c94-3a96-4057-8459-7d412179094b tempest-VolumesListTestJSON-1919245024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8819adc6-e151-4ea8-be65-328f0f0739c0" returned: 0 in 0.471s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1ad50c94-3a96-4057-8459-7d412179094b tempest-VolumesListTestJSON-1919245024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8819adc6-e151-4ea8-be65-328f0f0739c0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:25 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8819adc6-e151-4ea8-be65-328f0f0739c0 Sep 01 02:04:25 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:25 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1ad50c94-3a96-4057-8459-7d412179094b tempest-VolumesListTestJSON-1919245024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8819adc6-e151-4ea8-be65-328f0f0739c0" returned: 0 in 0.454s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1ad50c94-3a96-4057-8459-7d412179094b tempest-VolumesListTestJSON-1919245024 None] Lock "cinder-quobyte-8819adc6-e151-4ea8-be65-328f0f0739c0" released by "delete_volume" :: held 0.989s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:25 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-1ad50c94-3a96-4057-8459-7d412179094b tempest-VolumesListTestJSON-1919245024 None] Created reservations ['c7b04aec-6cdc-4cb0-814e-58ad2e2f4413', 'b5abb2d2-c84d-4b7e-beaa-face5f992a5d', '2cc8373c-5dfc-43fd-a55b-93d7ef36b7cc', '46622c23-e028-4623-b0b8-081fe340d0f3'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1ad50c94-3a96-4057-8459-7d412179094b tempest-VolumesListTestJSON-1919245024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1ad50c94-3a96-4057-8459-7d412179094b tempest-VolumesListTestJSON-1919245024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1ad50c94-3a96-4057-8459-7d412179094b tempest-VolumesListTestJSON-1919245024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1ad50c94-3a96-4057-8459-7d412179094b tempest-VolumesListTestJSON-1919245024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1ad50c94-3a96-4057-8459-7d412179094b tempest-VolumesListTestJSON-1919245024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1ad50c94-3a96-4057-8459-7d412179094b tempest-VolumesListTestJSON-1919245024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:25 devstack sudo[95775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:04:25 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:26 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1ad50c94-3a96-4057-8459-7d412179094b tempest-VolumesListTestJSON-1919245024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.374s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:26 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-1ad50c94-3a96-4057-8459-7d412179094b tempest-VolumesListTestJSON-1919245024 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:26 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-1ad50c94-3a96-4057-8459-7d412179094b tempest-VolumesListTestJSON-1919245024 None] Deleted volume successfully. Sep 01 02:04:26 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1ad50c94-3a96-4057-8459-7d412179094b tempest-VolumesListTestJSON-1919245024 None] Lock "cinder-8819adc6-e151-4ea8-be65-328f0f0739c0-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:29 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:04:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] Flow 'volume_create_manager' (c75784ac-fc82-4afc-b75b-0e69b35e14d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03ed759a-332d-4132-a0c4-f87f44b1595d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03ed759a-332d-4132-a0c4-f87f44b1595d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1557099566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5f74a07-17fb-469d-a908-d4b3291b804d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f97e230d7bef4d12ad7060960cfe5cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:29Z,use_quota=True,user_id='97752354ff134faaa3b606ac49d6275f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (452daac9-e9dc-4b88-87b5-114ba428fa41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (452daac9-e9dc-4b88-87b5-114ba428fa41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e40a977b-a5af-4c48-9f06-c82e141cb0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e40a977b-a5af-4c48-9f06-c82e141cb0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5f74a07-17fb-469d-a908-d4b3291b804d', 'volume_name': 'volume-e5f74a07-17fb-469d-a908-d4b3291b804d', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5913a0b-a717-48c6-a148-792bd9e2ac4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5913a0b-a717-48c6-a148-792bd9e2ac4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2272d0c2-a189-454f-92cf-904617b6b6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:29 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] Volume e5f74a07-17fb-469d-a908-d4b3291b804d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5f74a07-17fb-469d-a908-d4b3291b804d', 'volume_size': 1} Sep 01 02:04:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:29 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1557099566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5f74a07-17fb-469d-a908-d4b3291b804d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f97e230d7bef4d12ad7060960cfe5cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:29Z,use_quota=True,user_id='97752354ff134faaa3b606ac49d6275f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:04:29 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] Creating volume e5f74a07-17fb-469d-a908-d4b3291b804d {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:04:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:29 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:29 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:29 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:04:29 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:04:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e5f74a07-17fb-469d-a908-d4b3291b804d 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:29 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e5f74a07-17fb-469d-a908-d4b3291b804d 1073741824 Sep 01 02:04:29 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:30 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e5f74a07-17fb-469d-a908-d4b3291b804d 1073741824" returned: 0 in 0.714s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e5f74a07-17fb-469d-a908-d4b3291b804d {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:30 devstack sudo[95872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e5f74a07-17fb-469d-a908-d4b3291b804d Sep 01 02:04:30 devstack sudo[95872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e5f74a07-17fb-469d-a908-d4b3291b804d" returned: 0 in 0.682s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:31 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:31 devstack sudo[95872]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2272d0c2-a189-454f-92cf-904617b6b6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5f74a07-17fb-469d-a908-d4b3291b804d', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d8f695c-032c-4fb1-be45-5e8ab7037716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:31 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] Volume volume-e5f74a07-17fb-469d-a908-d4b3291b804d (e5f74a07-17fb-469d-a908-d4b3291b804d): created successfully Sep 01 02:04:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d8f695c-032c-4fb1-be45-5e8ab7037716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] Flow 'volume_create_manager' (c75784ac-fc82-4afc-b75b-0e69b35e14d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:31 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-83325cbb-08e9-425f-8a66-d41e8e2db0b2 tempest-AttachVolumeNegativeTest-545642174 None] Created volume successfully. Sep 01 02:04:32 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:04:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] Flow 'volume_create_manager' (0263b768-b19d-4d59-a611-88a0921f6db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56c961f4-ca3e-4740-9869-9bae96ab788d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56c961f4-ca3e-4740-9869-9bae96ab788d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1498519019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532a3ee1-e8f9-4482-a3de-95164615ed97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7391bd12be4c1f9ecb9aa1ac205f0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:32Z,use_quota=True,user_id='da01b3568e8e44e1a803447909cbb86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (219c66bc-34b8-443e-8361-67e976dda752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (219c66bc-34b8-443e-8361-67e976dda752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d67b33e-f69b-44f0-b1af-0cc681de1b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d67b33e-f69b-44f0-b1af-0cc681de1b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '532a3ee1-e8f9-4482-a3de-95164615ed97', 'volume_name': 'volume-532a3ee1-e8f9-4482-a3de-95164615ed97', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (febcf9e5-39bc-4b97-8b22-eb3f3864cbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (febcf9e5-39bc-4b97-8b22-eb3f3864cbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79458f46-5440-4004-a57c-8acb40bcc555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:32 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] Volume 532a3ee1-e8f9-4482-a3de-95164615ed97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-532a3ee1-e8f9-4482-a3de-95164615ed97', 'volume_size': 1} Sep 01 02:04:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:32 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1498519019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532a3ee1-e8f9-4482-a3de-95164615ed97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7391bd12be4c1f9ecb9aa1ac205f0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:32Z,use_quota=True,user_id='da01b3568e8e44e1a803447909cbb86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:04:32 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] Creating volume 532a3ee1-e8f9-4482-a3de-95164615ed97 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:04:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:32 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:32 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:32 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:04:32 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:04:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:32 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97 1073741824 Sep 01 02:04:32 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:33 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97 1073741824" returned: 0 in 0.946s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-c41db6cb-5481-4734-acdc-b2a4ef74e806 req-762f5e92-f159-4ac8-bb9e-a118382db328 tempest-AttachVolumeNegativeTest-545642174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:33 devstack sudo[95952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97 Sep 01 02:04:33 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:33 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97" returned: 0 in 0.334s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-c41db6cb-5481-4734-acdc-b2a4ef74e806 req-762f5e92-f159-4ac8-bb9e-a118382db328 tempest-AttachVolumeNegativeTest-545642174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.349s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-c41db6cb-5481-4734-acdc-b2a4ef74e806 req-762f5e92-f159-4ac8-bb9e-a118382db328 tempest-AttachVolumeNegativeTest-545642174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79458f46-5440-4004-a57c-8acb40bcc555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-532a3ee1-e8f9-4482-a3de-95164615ed97', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d83fcb27-0278-4472-896a-460a80e5b218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:33 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] Volume volume-532a3ee1-e8f9-4482-a3de-95164615ed97 (532a3ee1-e8f9-4482-a3de-95164615ed97): created successfully Sep 01 02:04:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d83fcb27-0278-4472-896a-460a80e5b218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] Flow 'volume_create_manager' (0263b768-b19d-4d59-a611-88a0921f6db9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:33 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-1cbd98d3-e75e-4063-9e13-f877cea17c44 tempest-VolumesSnapshotListTestJSON-1928021447 None] Created volume successfully. Sep 01 02:04:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-c41db6cb-5481-4734-acdc-b2a4ef74e806 req-762f5e92-f159-4ac8-bb9e-a118382db328 tempest-AttachVolumeNegativeTest-545642174 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb', 'name': 'volume-e5f74a07-17fb-469d-a908-d4b3291b804d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '648fb423-73ee-454c-83d9-d8696796af6e', 'enforce_multipath': True} {{(pid=87128) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:04:34 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-c41db6cb-5481-4734-acdc-b2a4ef74e806 req-762f5e92-f159-4ac8-bb9e-a118382db328 tempest-AttachVolumeNegativeTest-545642174 None] attachment_update completed successfully. Sep 01 02:04:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0d47b8b3-2bd4-449f-a848-257a82b7ce9b tempest-VolumesSnapshotListTestJSON-1928021447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0d47b8b3-2bd4-449f-a848-257a82b7ce9b tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:34 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-0d47b8b3-2bd4-449f-a848-257a82b7ce9b tempest-VolumesSnapshotListTestJSON-1928021447 None] Creating offline snapshot ac13ac73-6378-4e54-a86e-e60eaffbe632 of volume 532a3ee1-e8f9-4482-a3de-95164615ed97 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:04:34 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a92547-3f63-466a-955f-0a22e6164da1]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0d47b8b3-2bd4-449f-a848-257a82b7ce9b tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:34 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97 Sep 01 02:04:34 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:35 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0d47b8b3-2bd4-449f-a848-257a82b7ce9b tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97" returned: 0 in 0.523s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0d47b8b3-2bd4-449f-a848-257a82b7ce9b tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:35 devstack sudo[95962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632 1G Sep 01 02:04:35 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:35 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0d47b8b3-2bd4-449f-a848-257a82b7ce9b tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632 1G" returned: 0 in 0.809s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0d47b8b3-2bd4-449f-a848-257a82b7ce9b tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532a3ee1-e8f9-4482-a3de-95164615ed97 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:35 devstack sudo[95969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532a3ee1-e8f9-4482-a3de-95164615ed97 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632 Sep 01 02:04:35 devstack sudo[95969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:36 devstack sudo[95969]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0d47b8b3-2bd4-449f-a848-257a82b7ce9b tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532a3ee1-e8f9-4482-a3de-95164615ed97 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632" returned: 0 in 0.437s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:36 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-0d47b8b3-2bd4-449f-a848-257a82b7ce9b tempest-VolumesSnapshotListTestJSON-1928021447 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632 is being set with open permissions: ugo+rw Sep 01 02:04:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0d47b8b3-2bd4-449f-a848-257a82b7ce9b tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:36 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632 Sep 01 02:04:36 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:36 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0d47b8b3-2bd4-449f-a848-257a82b7ce9b tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632" returned: 0 in 0.443s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0d47b8b3-2bd4-449f-a848-257a82b7ce9b tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:36 devstack sudo[95978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.info Sep 01 02:04:36 devstack sudo[95978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:37 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-38f2ce69-af90-44f7-91bd-2a3fd2ebf78c req-1f97db89-b663-4e1c-8154-9b1a6d4ac5b1 tempest-AttachVolumeNegativeTest-545642174 None] Terminate volume connection completed successfully. Sep 01 02:04:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-38f2ce69-af90-44f7-91bd-2a3fd2ebf78c req-1f97db89-b663-4e1c-8154-9b1a6d4ac5b1 tempest-AttachVolumeNegativeTest-545642174 None] Deleting attachment 648fb423-73ee-454c-83d9-d8696796af6e. {{(pid=87128) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:04:37 devstack sudo[95978]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0d47b8b3-2bd4-449f-a848-257a82b7ce9b tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.info" returned: 0 in 0.313s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:37 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-0d47b8b3-2bd4-449f-a848-257a82b7ce9b tempest-VolumesSnapshotListTestJSON-1928021447 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.info is being set with open permissions: ugo+rw Sep 01 02:04:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0d47b8b3-2bd4-449f-a848-257a82b7ce9b tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:37 devstack sudo[95982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.info Sep 01 02:04:37 devstack sudo[95982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:37 devstack sudo[95982]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0d47b8b3-2bd4-449f-a848-257a82b7ce9b tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.info" returned: 0 in 0.331s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0d47b8b3-2bd4-449f-a848-257a82b7ce9b tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.026s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:37 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-0d47b8b3-2bd4-449f-a848-257a82b7ce9b tempest-VolumesSnapshotListTestJSON-1928021447 None] Create snapshot completed successfully Sep 01 02:04:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-617984b6-395f-4b3b-9af6-d5fca8eefe02 tempest-VolumesSnapshotListTestJSON-1928021447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-617984b6-395f-4b3b-9af6-d5fca8eefe02 tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:37 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-617984b6-395f-4b3b-9af6-d5fca8eefe02 tempest-VolumesSnapshotListTestJSON-1928021447 None] Creating offline snapshot b04a00de-61fe-4c49-96ef-4941b3df94b5 of volume 532a3ee1-e8f9-4482-a3de-95164615ed97 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:04:38 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9119c81-8fea-47a0-b012-6957d1462ab1]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-617984b6-395f-4b3b-9af6-d5fca8eefe02 tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:38 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632 Sep 01 02:04:38 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:38 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-617984b6-395f-4b3b-9af6-d5fca8eefe02 tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632" returned: 0 in 0.692s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:38 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-617984b6-395f-4b3b-9af6-d5fca8eefe02 tempest-VolumesSnapshotListTestJSON-1928021447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-532a3ee1-e8f9-4482-a3de-95164615ed97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:04:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-617984b6-395f-4b3b-9af6-d5fca8eefe02 tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:38 devstack sudo[96008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5 1G Sep 01 02:04:38 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:39 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-617984b6-395f-4b3b-9af6-d5fca8eefe02 tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5 1G" returned: 0 in 1.052s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-617984b6-395f-4b3b-9af6-d5fca8eefe02 tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:39 devstack sudo[96027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5 Sep 01 02:04:39 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:40 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-617984b6-395f-4b3b-9af6-d5fca8eefe02 tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5" returned: 0 in 0.555s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:40 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-617984b6-395f-4b3b-9af6-d5fca8eefe02 tempest-VolumesSnapshotListTestJSON-1928021447 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5 is being set with open permissions: ugo+rw Sep 01 02:04:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-617984b6-395f-4b3b-9af6-d5fca8eefe02 tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:40 devstack sudo[96037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5 Sep 01 02:04:40 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:40 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-617984b6-395f-4b3b-9af6-d5fca8eefe02 tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5" returned: 0 in 0.503s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-617984b6-395f-4b3b-9af6-d5fca8eefe02 tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.035s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:41 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-617984b6-395f-4b3b-9af6-d5fca8eefe02 tempest-VolumesSnapshotListTestJSON-1928021447 None] Create snapshot completed successfully Sep 01 02:04:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-833a8eb4-2c9a-4fe1-a0a9-fd17bd548fc1 tempest-VolumesSnapshotListTestJSON-1928021447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-833a8eb4-2c9a-4fe1-a0a9-fd17bd548fc1 tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-833a8eb4-2c9a-4fe1-a0a9-fd17bd548fc1 tempest-VolumesSnapshotListTestJSON-1928021447 None] Creating offline snapshot eb2a6f98-53fc-4692-86fc-35d91643078a of volume 532a3ee1-e8f9-4482-a3de-95164615ed97 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:04:41 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4411b84-10bf-4d06-81a7-ffe76317becc]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-833a8eb4-2c9a-4fe1-a0a9-fd17bd548fc1 tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:41 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5 Sep 01 02:04:41 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:42 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-833a8eb4-2c9a-4fe1-a0a9-fd17bd548fc1 tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5" returned: 0 in 0.461s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-833a8eb4-2c9a-4fe1-a0a9-fd17bd548fc1 tempest-VolumesSnapshotListTestJSON-1928021447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-532a3ee1-e8f9-4482-a3de-95164615ed97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:04:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-833a8eb4-2c9a-4fe1-a0a9-fd17bd548fc1 tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.eb2a6f98-53fc-4692-86fc-35d91643078a 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:42 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.eb2a6f98-53fc-4692-86fc-35d91643078a 1G Sep 01 02:04:42 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:42 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-833a8eb4-2c9a-4fe1-a0a9-fd17bd548fc1 tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.eb2a6f98-53fc-4692-86fc-35d91643078a 1G" returned: 0 in 0.460s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-833a8eb4-2c9a-4fe1-a0a9-fd17bd548fc1 tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.eb2a6f98-53fc-4692-86fc-35d91643078a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:42 devstack sudo[96054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.eb2a6f98-53fc-4692-86fc-35d91643078a Sep 01 02:04:42 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:43 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-833a8eb4-2c9a-4fe1-a0a9-fd17bd548fc1 tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.eb2a6f98-53fc-4692-86fc-35d91643078a" returned: 0 in 0.355s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:43 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-833a8eb4-2c9a-4fe1-a0a9-fd17bd548fc1 tempest-VolumesSnapshotListTestJSON-1928021447 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.eb2a6f98-53fc-4692-86fc-35d91643078a is being set with open permissions: ugo+rw Sep 01 02:04:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-833a8eb4-2c9a-4fe1-a0a9-fd17bd548fc1 tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.eb2a6f98-53fc-4692-86fc-35d91643078a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:43 devstack sudo[96060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.eb2a6f98-53fc-4692-86fc-35d91643078a Sep 01 02:04:43 devstack sudo[96060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:43 devstack sudo[96060]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-833a8eb4-2c9a-4fe1-a0a9-fd17bd548fc1 tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.eb2a6f98-53fc-4692-86fc-35d91643078a" returned: 0 in 0.396s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-833a8eb4-2c9a-4fe1-a0a9-fd17bd548fc1 tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.813s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:43 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-833a8eb4-2c9a-4fe1-a0a9-fd17bd548fc1 tempest-VolumesSnapshotListTestJSON-1928021447 None] Create snapshot completed successfully Sep 01 02:04:44 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8e1d7d89-a9d1-4b31-996b-078a2ad2116f tempest-VolumesSnapshotListTestJSON-1928021447 None] Acquiring lock "cinder-eb2a6f98-53fc-4692-86fc-35d91643078a-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:44 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8e1d7d89-a9d1-4b31-996b-078a2ad2116f tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "cinder-eb2a6f98-53fc-4692-86fc-35d91643078a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:44 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8e1d7d89-a9d1-4b31-996b-078a2ad2116f tempest-VolumesSnapshotListTestJSON-1928021447 None] Acquiring lock "cinder-quobyte-532a3ee1-e8f9-4482-a3de-95164615ed97" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:44 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8e1d7d89-a9d1-4b31-996b-078a2ad2116f tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "cinder-quobyte-532a3ee1-e8f9-4482-a3de-95164615ed97" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:44 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8e1d7d89-a9d1-4b31-996b-078a2ad2116f tempest-VolumesSnapshotListTestJSON-1928021447 None] Acquiring lock "cinder-quobyte-eb2a6f98-53fc-4692-86fc-35d91643078a" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:45 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8e1d7d89-a9d1-4b31-996b-078a2ad2116f tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "cinder-quobyte-eb2a6f98-53fc-4692-86fc-35d91643078a" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:45 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-8e1d7d89-a9d1-4b31-996b-078a2ad2116f tempest-VolumesSnapshotListTestJSON-1928021447 None] Deleting offline snapshot eb2a6f98-53fc-4692-86fc-35d91643078a of volume 532a3ee1-e8f9-4482-a3de-95164615ed97 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:04:45 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-8e1d7d89-a9d1-4b31-996b-078a2ad2116f tempest-VolumesSnapshotListTestJSON-1928021447 None] snapshot_file for this snap is: volume-532a3ee1-e8f9-4482-a3de-95164615ed97.eb2a6f98-53fc-4692-86fc-35d91643078a {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:04:45 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[db28d7f1-9de7-42e6-a1d6-f90928a638ac]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8e1d7d89-a9d1-4b31-996b-078a2ad2116f tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.eb2a6f98-53fc-4692-86fc-35d91643078a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:45 devstack sudo[96063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.eb2a6f98-53fc-4692-86fc-35d91643078a Sep 01 02:04:45 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:45 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8e1d7d89-a9d1-4b31-996b-078a2ad2116f tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.eb2a6f98-53fc-4692-86fc-35d91643078a" returned: 0 in 0.549s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:45 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-8e1d7d89-a9d1-4b31-996b-078a2ad2116f tempest-VolumesSnapshotListTestJSON-1928021447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-532a3ee1-e8f9-4482-a3de-95164615ed97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:04:45 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9680f1-003e-4478-8e61-50cb04181e8b]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8e1d7d89-a9d1-4b31-996b-078a2ad2116f tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:45 devstack sudo[96070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5 Sep 01 02:04:45 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:46 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8e1d7d89-a9d1-4b31-996b-078a2ad2116f tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5" returned: 0 in 0.523s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-8e1d7d89-a9d1-4b31-996b-078a2ad2116f tempest-VolumesSnapshotListTestJSON-1928021447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-532a3ee1-e8f9-4482-a3de-95164615ed97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:04:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8e1d7d89-a9d1-4b31-996b-078a2ad2116f tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.eb2a6f98-53fc-4692-86fc-35d91643078a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:46 devstack sudo[96075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.eb2a6f98-53fc-4692-86fc-35d91643078a Sep 01 02:04:46 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:46 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8e1d7d89-a9d1-4b31-996b-078a2ad2116f tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.eb2a6f98-53fc-4692-86fc-35d91643078a" returned: 0 in 0.425s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8e1d7d89-a9d1-4b31-996b-078a2ad2116f tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.eb2a6f98-53fc-4692-86fc-35d91643078a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:46 devstack sudo[96080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.eb2a6f98-53fc-4692-86fc-35d91643078a Sep 01 02:04:46 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:46 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8e1d7d89-a9d1-4b31-996b-078a2ad2116f tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.eb2a6f98-53fc-4692-86fc-35d91643078a" returned: 0 in 0.276s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8e1d7d89-a9d1-4b31-996b-078a2ad2116f tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "cinder-quobyte-eb2a6f98-53fc-4692-86fc-35d91643078a" released by "_delete_snapshot" :: held 1.918s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8e1d7d89-a9d1-4b31-996b-078a2ad2116f tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "cinder-quobyte-532a3ee1-e8f9-4482-a3de-95164615ed97" released by "delete_snapshot" :: held 1.968s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:47 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-8e1d7d89-a9d1-4b31-996b-078a2ad2116f tempest-VolumesSnapshotListTestJSON-1928021447 None] Created reservations ['459a80e7-c56d-42f2-a0d8-e47a5978a392', '7ff691a2-a80d-4c77-8f12-227227b546e4', '3ee38de1-976e-4a63-9468-cc5fef880417', 'dfa0ef2d-5019-4271-8391-9b83f2b34d64'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:47 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-8e1d7d89-a9d1-4b31-996b-078a2ad2116f tempest-VolumesSnapshotListTestJSON-1928021447 None] Delete snapshot completed successfully. Sep 01 02:04:47 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8e1d7d89-a9d1-4b31-996b-078a2ad2116f tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "cinder-eb2a6f98-53fc-4692-86fc-35d91643078a-delete_snapshot" released by "delete_snapshot" :: held 2.187s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:48 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-44b13171-c233-4d5a-9b85-dea3a4ccfe04 tempest-VolumesSnapshotListTestJSON-1928021447 None] Acquiring lock "cinder-b04a00de-61fe-4c49-96ef-4941b3df94b5-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:48 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-44b13171-c233-4d5a-9b85-dea3a4ccfe04 tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "cinder-b04a00de-61fe-4c49-96ef-4941b3df94b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:48 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-44b13171-c233-4d5a-9b85-dea3a4ccfe04 tempest-VolumesSnapshotListTestJSON-1928021447 None] Acquiring lock "cinder-quobyte-532a3ee1-e8f9-4482-a3de-95164615ed97" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:48 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-44b13171-c233-4d5a-9b85-dea3a4ccfe04 tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "cinder-quobyte-532a3ee1-e8f9-4482-a3de-95164615ed97" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:48 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-44b13171-c233-4d5a-9b85-dea3a4ccfe04 tempest-VolumesSnapshotListTestJSON-1928021447 None] Acquiring lock "cinder-quobyte-b04a00de-61fe-4c49-96ef-4941b3df94b5" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:48 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-44b13171-c233-4d5a-9b85-dea3a4ccfe04 tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "cinder-quobyte-b04a00de-61fe-4c49-96ef-4941b3df94b5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:48 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-44b13171-c233-4d5a-9b85-dea3a4ccfe04 tempest-VolumesSnapshotListTestJSON-1928021447 None] Deleting offline snapshot b04a00de-61fe-4c49-96ef-4941b3df94b5 of volume 532a3ee1-e8f9-4482-a3de-95164615ed97 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:04:48 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-44b13171-c233-4d5a-9b85-dea3a4ccfe04 tempest-VolumesSnapshotListTestJSON-1928021447 None] snapshot_file for this snap is: volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:04:48 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e0783d-1670-41ec-a320-cd96d06e89cd]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-44b13171-c233-4d5a-9b85-dea3a4ccfe04 tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:48 devstack sudo[96110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5 Sep 01 02:04:48 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:48 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-44b13171-c233-4d5a-9b85-dea3a4ccfe04 tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5" returned: 0 in 0.402s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:48 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-44b13171-c233-4d5a-9b85-dea3a4ccfe04 tempest-VolumesSnapshotListTestJSON-1928021447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-532a3ee1-e8f9-4482-a3de-95164615ed97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:04:48 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c47dd3-7cef-4fab-b155-c235456017a1]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-44b13171-c233-4d5a-9b85-dea3a4ccfe04 tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:48 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632 Sep 01 02:04:48 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:49 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-44b13171-c233-4d5a-9b85-dea3a4ccfe04 tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632" returned: 0 in 0.411s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-44b13171-c233-4d5a-9b85-dea3a4ccfe04 tempest-VolumesSnapshotListTestJSON-1928021447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-532a3ee1-e8f9-4482-a3de-95164615ed97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:04:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-44b13171-c233-4d5a-9b85-dea3a4ccfe04 tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:49 devstack sudo[96120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5 Sep 01 02:04:49 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:49 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-44b13171-c233-4d5a-9b85-dea3a4ccfe04 tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5" returned: 0 in 0.478s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-44b13171-c233-4d5a-9b85-dea3a4ccfe04 tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:49 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5 Sep 01 02:04:49 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:49 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-44b13171-c233-4d5a-9b85-dea3a4ccfe04 tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.b04a00de-61fe-4c49-96ef-4941b3df94b5" returned: 0 in 0.305s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-44b13171-c233-4d5a-9b85-dea3a4ccfe04 tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "cinder-quobyte-b04a00de-61fe-4c49-96ef-4941b3df94b5" released by "_delete_snapshot" :: held 1.716s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-44b13171-c233-4d5a-9b85-dea3a4ccfe04 tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "cinder-quobyte-532a3ee1-e8f9-4482-a3de-95164615ed97" released by "delete_snapshot" :: held 1.738s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:50 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-44b13171-c233-4d5a-9b85-dea3a4ccfe04 tempest-VolumesSnapshotListTestJSON-1928021447 None] Created reservations ['dee45641-30f0-4036-837c-1a01445ccaac', '7059e3ab-da33-45f8-bd03-b0215c7482aa', 'c9be6389-b414-4e02-a9a0-2c420264541f', '09b038ad-31bc-45fa-a753-1f9230c2ae68'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:50 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-44b13171-c233-4d5a-9b85-dea3a4ccfe04 tempest-VolumesSnapshotListTestJSON-1928021447 None] Delete snapshot completed successfully. Sep 01 02:04:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-44b13171-c233-4d5a-9b85-dea3a4ccfe04 tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "cinder-b04a00de-61fe-4c49-96ef-4941b3df94b5-delete_snapshot" released by "delete_snapshot" :: held 1.910s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bf0c400f-a0c1-4ded-b780-4ac535f0a471 tempest-VolumesSnapshotListTestJSON-1928021447 None] Acquiring lock "cinder-ac13ac73-6378-4e54-a86e-e60eaffbe632-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bf0c400f-a0c1-4ded-b780-4ac535f0a471 tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "cinder-ac13ac73-6378-4e54-a86e-e60eaffbe632-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bf0c400f-a0c1-4ded-b780-4ac535f0a471 tempest-VolumesSnapshotListTestJSON-1928021447 None] Acquiring lock "cinder-quobyte-532a3ee1-e8f9-4482-a3de-95164615ed97" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bf0c400f-a0c1-4ded-b780-4ac535f0a471 tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "cinder-quobyte-532a3ee1-e8f9-4482-a3de-95164615ed97" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bf0c400f-a0c1-4ded-b780-4ac535f0a471 tempest-VolumesSnapshotListTestJSON-1928021447 None] Acquiring lock "cinder-quobyte-ac13ac73-6378-4e54-a86e-e60eaffbe632" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bf0c400f-a0c1-4ded-b780-4ac535f0a471 tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "cinder-quobyte-ac13ac73-6378-4e54-a86e-e60eaffbe632" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:50 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-bf0c400f-a0c1-4ded-b780-4ac535f0a471 tempest-VolumesSnapshotListTestJSON-1928021447 None] Deleting offline snapshot ac13ac73-6378-4e54-a86e-e60eaffbe632 of volume 532a3ee1-e8f9-4482-a3de-95164615ed97 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:04:50 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-bf0c400f-a0c1-4ded-b780-4ac535f0a471 tempest-VolumesSnapshotListTestJSON-1928021447 None] snapshot_file for this snap is: volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:04:50 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3cd736-697c-4e8b-9337-e37ea9ad2d2b]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bf0c400f-a0c1-4ded-b780-4ac535f0a471 tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:50 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632 Sep 01 02:04:50 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:50 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bf0c400f-a0c1-4ded-b780-4ac535f0a471 tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632" returned: 0 in 0.401s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:50 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-bf0c400f-a0c1-4ded-b780-4ac535f0a471 tempest-VolumesSnapshotListTestJSON-1928021447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-532a3ee1-e8f9-4482-a3de-95164615ed97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:04:50 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[207eb1c5-39d1-468f-a3ab-56106988b5a4]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bf0c400f-a0c1-4ded-b780-4ac535f0a471 tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:51 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97 Sep 01 02:04:51 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:51 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bf0c400f-a0c1-4ded-b780-4ac535f0a471 tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97" returned: 0 in 0.407s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bf0c400f-a0c1-4ded-b780-4ac535f0a471 tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:51 devstack sudo[96158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632 Sep 01 02:04:51 devstack sudo[96158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:51 devstack sudo[96158]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bf0c400f-a0c1-4ded-b780-4ac535f0a471 tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632" returned: 0 in 0.411s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bf0c400f-a0c1-4ded-b780-4ac535f0a471 tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:51 devstack sudo[96165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632 Sep 01 02:04:51 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:52 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bf0c400f-a0c1-4ded-b780-4ac535f0a471 tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97.ac13ac73-6378-4e54-a86e-e60eaffbe632" returned: 0 in 0.423s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bf0c400f-a0c1-4ded-b780-4ac535f0a471 tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "cinder-quobyte-ac13ac73-6378-4e54-a86e-e60eaffbe632" released by "_delete_snapshot" :: held 1.794s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bf0c400f-a0c1-4ded-b780-4ac535f0a471 tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "cinder-quobyte-532a3ee1-e8f9-4482-a3de-95164615ed97" released by "delete_snapshot" :: held 1.834s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:52 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-bf0c400f-a0c1-4ded-b780-4ac535f0a471 tempest-VolumesSnapshotListTestJSON-1928021447 None] Created reservations ['12c7c31a-dc61-4d0b-8120-f4af15d3c71d', '92cc4224-dfc9-4a8b-8bc8-0877185ea745', '423155d9-1e7a-4c8c-bb41-d2e1d37d67fe', 'eef6a7c7-c7b7-49db-9f67-a486b1519e08'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:52 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-bf0c400f-a0c1-4ded-b780-4ac535f0a471 tempest-VolumesSnapshotListTestJSON-1928021447 None] Delete snapshot completed successfully. Sep 01 02:04:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bf0c400f-a0c1-4ded-b780-4ac535f0a471 tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "cinder-ac13ac73-6378-4e54-a86e-e60eaffbe632-delete_snapshot" released by "delete_snapshot" :: held 2.064s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-82192744-bee9-4019-8641-993baa5c5b53 tempest-VolumesSnapshotListTestJSON-1928021447 None] Acquiring lock "cinder-532a3ee1-e8f9-4482-a3de-95164615ed97-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-82192744-bee9-4019-8641-993baa5c5b53 tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "cinder-532a3ee1-e8f9-4482-a3de-95164615ed97-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:52 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=76,cinder:INSERT=16,cinder:UPDATE=75,cinder:DELETE=6 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:04:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-82192744-bee9-4019-8641-993baa5c5b53 tempest-VolumesSnapshotListTestJSON-1928021447 None] Acquiring lock "cinder-quobyte-532a3ee1-e8f9-4482-a3de-95164615ed97" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-82192744-bee9-4019-8641-993baa5c5b53 tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "cinder-quobyte-532a3ee1-e8f9-4482-a3de-95164615ed97" acquired by "delete_volume" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:52 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83b5d59-3251-4fc0-8038-64e34e4a0a3b]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-82192744-bee9-4019-8641-993baa5c5b53 tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:53 devstack sudo[96231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97 Sep 01 02:04:53 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:53 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-82192744-bee9-4019-8641-993baa5c5b53 tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97" returned: 0 in 0.490s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-82192744-bee9-4019-8641-993baa5c5b53 tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:53 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97 Sep 01 02:04:53 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:53 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-82192744-bee9-4019-8641-993baa5c5b53 tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-532a3ee1-e8f9-4482-a3de-95164615ed97" returned: 0 in 0.407s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-82192744-bee9-4019-8641-993baa5c5b53 tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "cinder-quobyte-532a3ee1-e8f9-4482-a3de-95164615ed97" released by "delete_volume" :: held 0.998s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:53 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:UPDATE=79,cinder:SELECT=70,cinder:INSERT=20,cinder:DELETE=8 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:04:54 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-82192744-bee9-4019-8641-993baa5c5b53 tempest-VolumesSnapshotListTestJSON-1928021447 None] Created reservations ['b764be6d-a498-438a-a48e-31cd58a6aa08', '99d7d0e7-4fa2-4734-a3c0-e17caa1c96c9', '501e127c-992e-4a5e-9d5b-93f79bfa8c08', '7047db77-e617-4ded-9d1e-95d1930610ed'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-82192744-bee9-4019-8641-993baa5c5b53 tempest-VolumesSnapshotListTestJSON-1928021447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-82192744-bee9-4019-8641-993baa5c5b53 tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-82192744-bee9-4019-8641-993baa5c5b53 tempest-VolumesSnapshotListTestJSON-1928021447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-82192744-bee9-4019-8641-993baa5c5b53 tempest-VolumesSnapshotListTestJSON-1928021447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-82192744-bee9-4019-8641-993baa5c5b53 tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-82192744-bee9-4019-8641-993baa5c5b53 tempest-VolumesSnapshotListTestJSON-1928021447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:54 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:04:54 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:54 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-82192744-bee9-4019-8641-993baa5c5b53 tempest-VolumesSnapshotListTestJSON-1928021447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.413s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:54 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-82192744-bee9-4019-8641-993baa5c5b53 tempest-VolumesSnapshotListTestJSON-1928021447 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:54 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-82192744-bee9-4019-8641-993baa5c5b53 tempest-VolumesSnapshotListTestJSON-1928021447 None] Deleted volume successfully. Sep 01 02:04:54 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-82192744-bee9-4019-8641-993baa5c5b53 tempest-VolumesSnapshotListTestJSON-1928021447 None] Lock "cinder-532a3ee1-e8f9-4482-a3de-95164615ed97-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:56 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:04:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] Flow 'volume_create_manager' (265c4a7c-6841-44c7-a2f0-0775a686259e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (101b5f17-4b0e-4525-adc9-e90da0e36d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (101b5f17-4b0e-4525-adc9-e90da0e36d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-806661332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c04e46c9-2d70-4646-a534-358a3563d43f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f53f3ab35f0487d8442cf12da1fa192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:57Z,use_quota=True,user_id='4798cfcc0d0b4166a6fd2fabc87ec847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d56dc1a-feb1-47e7-91eb-614b3cb312e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d56dc1a-feb1-47e7-91eb-614b3cb312e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6fb0d54-9331-4bd5-ab6d-611e8ad98d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6fb0d54-9331-4bd5-ab6d-611e8ad98d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c04e46c9-2d70-4646-a534-358a3563d43f', 'volume_name': 'volume-c04e46c9-2d70-4646-a534-358a3563d43f', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c1d381-efd1-48a3-ab0b-c1ec51f0c89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c1d381-efd1-48a3-ab0b-c1ec51f0c89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2833118c-c8a3-4e9e-a15a-cce0099700ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:56 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] Volume c04e46c9-2d70-4646-a534-358a3563d43f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c04e46c9-2d70-4646-a534-358a3563d43f', 'volume_size': 1} Sep 01 02:04:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:56 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-806661332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c04e46c9-2d70-4646-a534-358a3563d43f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f53f3ab35f0487d8442cf12da1fa192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:57Z,use_quota=True,user_id='4798cfcc0d0b4166a6fd2fabc87ec847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:04:56 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] Creating volume c04e46c9-2d70-4646-a534-358a3563d43f {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:04:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:56 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:56 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:56 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:04:56 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:04:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c04e46c9-2d70-4646-a534-358a3563d43f 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:56 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c04e46c9-2d70-4646-a534-358a3563d43f 1073741824 Sep 01 02:04:56 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:57 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c04e46c9-2d70-4646-a534-358a3563d43f 1073741824" returned: 0 in 0.768s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c04e46c9-2d70-4646-a534-358a3563d43f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:57 devstack sudo[96259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c04e46c9-2d70-4646-a534-358a3563d43f Sep 01 02:04:57 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:57 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c04e46c9-2d70-4646-a534-358a3563d43f" returned: 0 in 0.265s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2833118c-c8a3-4e9e-a15a-cce0099700ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c04e46c9-2d70-4646-a534-358a3563d43f', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1901a5f7-e0ff-4de3-aa0c-affc739c8197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:57 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] Volume volume-c04e46c9-2d70-4646-a534-358a3563d43f (c04e46c9-2d70-4646-a534-358a3563d43f): created successfully Sep 01 02:04:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1901a5f7-e0ff-4de3-aa0c-affc739c8197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] Flow 'volume_create_manager' (265c4a7c-6841-44c7-a2f0-0775a686259e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:57 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-46467ad0-6ec9-4472-944a-ec997caaf642 tempest-AttachVolumeTestJSON-602593005 None] Created volume successfully. Sep 01 02:04:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-e4d0ae62-eb68-4439-a5fb-a3982c79b1c5 req-1ff5b75b-efcc-472b-aeff-5043e07b8643 tempest-AttachVolumeTestJSON-602593005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-e4d0ae62-eb68-4439-a5fb-a3982c79b1c5 req-1ff5b75b-efcc-472b-aeff-5043e07b8643 tempest-AttachVolumeTestJSON-602593005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-e4d0ae62-eb68-4439-a5fb-a3982c79b1c5 req-1ff5b75b-efcc-472b-aeff-5043e07b8643 tempest-AttachVolumeTestJSON-602593005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:59 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-e4d0ae62-eb68-4439-a5fb-a3982c79b1c5 req-1ff5b75b-efcc-472b-aeff-5043e07b8643 tempest-AttachVolumeTestJSON-602593005 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb', 'name': 'volume-c04e46c9-2d70-4646-a534-358a3563d43f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a6138741-b5c6-416f-a27c-89db60c7a28b', 'enforce_multipath': True} {{(pid=87128) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:04:59 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-e4d0ae62-eb68-4439-a5fb-a3982c79b1c5 req-1ff5b75b-efcc-472b-aeff-5043e07b8643 tempest-AttachVolumeTestJSON-602593005 None] attachment_update completed successfully. Sep 01 02:05:02 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:05:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] Flow 'volume_create_manager' (e2f98c19-645c-4e45-bab5-4a08c5874637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5683d7c3-0ac4-44d0-bab9-00fe7cc2d59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5683d7c3-0ac4-44d0-bab9-00fe7cc2d59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2070929560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=266c10f1-66cc-463e-adc9-340db23f350b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f53f3ab35f0487d8442cf12da1fa192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:03Z,use_quota=True,user_id='4798cfcc0d0b4166a6fd2fabc87ec847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (724a5fb0-52cd-4c0a-8d8c-861bfd263b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (724a5fb0-52cd-4c0a-8d8c-861bfd263b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4403101-d98d-45c3-a4bb-ddd93d167052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4403101-d98d-45c3-a4bb-ddd93d167052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '266c10f1-66cc-463e-adc9-340db23f350b', 'volume_name': 'volume-266c10f1-66cc-463e-adc9-340db23f350b', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908a0737-2c96-4449-9859-4e2ffd48bb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908a0737-2c96-4449-9859-4e2ffd48bb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a106625-fa31-4850-a0cc-4f9aeed8a846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:02 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] Volume 266c10f1-66cc-463e-adc9-340db23f350b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-266c10f1-66cc-463e-adc9-340db23f350b', 'volume_size': 1} Sep 01 02:05:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2070929560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=266c10f1-66cc-463e-adc9-340db23f350b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f53f3ab35f0487d8442cf12da1fa192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:03Z,use_quota=True,user_id='4798cfcc0d0b4166a6fd2fabc87ec847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:05:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] Creating volume 266c10f1-66cc-463e-adc9-340db23f350b {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:05:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:05:02 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:05:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-266c10f1-66cc-463e-adc9-340db23f350b 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:02 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-266c10f1-66cc-463e-adc9-340db23f350b 1073741824 Sep 01 02:05:02 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:03 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-266c10f1-66cc-463e-adc9-340db23f350b 1073741824" returned: 0 in 0.597s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-266c10f1-66cc-463e-adc9-340db23f350b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:03 devstack sudo[96286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-266c10f1-66cc-463e-adc9-340db23f350b Sep 01 02:05:03 devstack sudo[96286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:03 devstack sudo[96286]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-266c10f1-66cc-463e-adc9-340db23f350b" returned: 0 in 0.315s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:03 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:05:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a106625-fa31-4850-a0cc-4f9aeed8a846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-266c10f1-66cc-463e-adc9-340db23f350b', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73af8d2c-e89f-48b3-a626-2d8715f8cc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:03 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] Volume volume-266c10f1-66cc-463e-adc9-340db23f350b (266c10f1-66cc-463e-adc9-340db23f350b): created successfully Sep 01 02:05:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73af8d2c-e89f-48b3-a626-2d8715f8cc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] Flow 'volume_create_manager' (e2f98c19-645c-4e45-bab5-4a08c5874637) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:03 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-57f96099-2df9-4d84-b5d4-9d71eea990fc tempest-AttachVolumeTestJSON-602593005 None] Created volume successfully. Sep 01 02:05:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-e05c5ae2-8f81-4324-ada6-a66711cb7b35 req-f4b029e2-14c0-4d89-ac82-ac5bd23cb4ff tempest-AttachVolumeTestJSON-602593005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-e05c5ae2-8f81-4324-ada6-a66711cb7b35 req-f4b029e2-14c0-4d89-ac82-ac5bd23cb4ff tempest-AttachVolumeTestJSON-602593005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-e05c5ae2-8f81-4324-ada6-a66711cb7b35 req-f4b029e2-14c0-4d89-ac82-ac5bd23cb4ff tempest-AttachVolumeTestJSON-602593005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-e05c5ae2-8f81-4324-ada6-a66711cb7b35 req-f4b029e2-14c0-4d89-ac82-ac5bd23cb4ff tempest-AttachVolumeTestJSON-602593005 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb', 'name': 'volume-266c10f1-66cc-463e-adc9-340db23f350b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aebcb6d7-dd12-41c8-898d-9d6575fd516d', 'enforce_multipath': True} {{(pid=87128) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:05:05 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-e05c5ae2-8f81-4324-ada6-a66711cb7b35 req-f4b029e2-14c0-4d89-ac82-ac5bd23cb4ff tempest-AttachVolumeTestJSON-602593005 None] attachment_update completed successfully. Sep 01 02:05:07 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-8b3f6be1-4803-4b98-861a-c3ae9922315e req-f5394a9c-f337-4723-9309-9544ecc8582b tempest-AttachVolumeTestJSON-602593005 None] Terminate volume connection completed successfully. Sep 01 02:05:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-8b3f6be1-4803-4b98-861a-c3ae9922315e req-f5394a9c-f337-4723-9309-9544ecc8582b tempest-AttachVolumeTestJSON-602593005 None] Deleting attachment a6138741-b5c6-416f-a27c-89db60c7a28b. {{(pid=87128) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:05:09 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-d5af690e-9cbf-4ccd-b7a5-34b6de561969 req-6029fb98-122d-48b2-8b21-d52417cfb8ca tempest-AttachVolumeTestJSON-602593005 None] Terminate volume connection completed successfully. Sep 01 02:05:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-d5af690e-9cbf-4ccd-b7a5-34b6de561969 req-6029fb98-122d-48b2-8b21-d52417cfb8ca tempest-AttachVolumeTestJSON-602593005 None] Deleting attachment aebcb6d7-dd12-41c8-898d-9d6575fd516d. {{(pid=87128) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:05:11 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-054fab49-7e5c-4081-abd5-1ee88e4fa02d req-d10d29c9-78d7-4b82-8239-d9529e08c86b tempest-TestMinimumBasicScenario-1690085929 None] Terminate volume connection completed successfully. Sep 01 02:05:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-054fab49-7e5c-4081-abd5-1ee88e4fa02d req-d10d29c9-78d7-4b82-8239-d9529e08c86b tempest-TestMinimumBasicScenario-1690085929 None] Deleting attachment 49a6719b-d553-4e81-ac63-d328a0456ea0. {{(pid=87128) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:05:12 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f65e7344-4e5e-49b2-9bb5-d45a97744e79 tempest-TestMinimumBasicScenario-1690085929 None] Acquiring lock "cinder-264c87a9-4e19-4b96-bfaa-d7d9384e0cca-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:12 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f65e7344-4e5e-49b2-9bb5-d45a97744e79 tempest-TestMinimumBasicScenario-1690085929 None] Lock "cinder-264c87a9-4e19-4b96-bfaa-d7d9384e0cca-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:12 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f65e7344-4e5e-49b2-9bb5-d45a97744e79 tempest-TestMinimumBasicScenario-1690085929 None] Acquiring lock "cinder-quobyte-264c87a9-4e19-4b96-bfaa-d7d9384e0cca" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:12 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f65e7344-4e5e-49b2-9bb5-d45a97744e79 tempest-TestMinimumBasicScenario-1690085929 None] Lock "cinder-quobyte-264c87a9-4e19-4b96-bfaa-d7d9384e0cca" acquired by "delete_volume" :: waited 0.020s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:12 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1014df-cbb9-4ff2-9e9a-886de7591e57]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f65e7344-4e5e-49b2-9bb5-d45a97744e79 tempest-TestMinimumBasicScenario-1690085929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-264c87a9-4e19-4b96-bfaa-d7d9384e0cca {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:13 devstack sudo[96361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-264c87a9-4e19-4b96-bfaa-d7d9384e0cca Sep 01 02:05:13 devstack sudo[96361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:13 devstack sudo[96361]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f65e7344-4e5e-49b2-9bb5-d45a97744e79 tempest-TestMinimumBasicScenario-1690085929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-264c87a9-4e19-4b96-bfaa-d7d9384e0cca" returned: 0 in 0.527s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f65e7344-4e5e-49b2-9bb5-d45a97744e79 tempest-TestMinimumBasicScenario-1690085929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-264c87a9-4e19-4b96-bfaa-d7d9384e0cca {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:13 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-264c87a9-4e19-4b96-bfaa-d7d9384e0cca Sep 01 02:05:13 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:13 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f65e7344-4e5e-49b2-9bb5-d45a97744e79 tempest-TestMinimumBasicScenario-1690085929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-264c87a9-4e19-4b96-bfaa-d7d9384e0cca" returned: 0 in 0.499s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:13 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f65e7344-4e5e-49b2-9bb5-d45a97744e79 tempest-TestMinimumBasicScenario-1690085929 None] Lock "cinder-quobyte-264c87a9-4e19-4b96-bfaa-d7d9384e0cca" released by "delete_volume" :: held 1.086s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:14 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-f65e7344-4e5e-49b2-9bb5-d45a97744e79 tempest-TestMinimumBasicScenario-1690085929 None] Created reservations ['cc643122-4f1c-4ab4-aedf-2bc51532c0b2', 'e2796674-37c5-4b76-8042-a70611835b6c', '53cce76e-34ea-4c73-876f-609c247c51a6', '1b6401ad-094f-4e15-9117-ebe3512b9149'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:05:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f65e7344-4e5e-49b2-9bb5-d45a97744e79 tempest-TestMinimumBasicScenario-1690085929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f65e7344-4e5e-49b2-9bb5-d45a97744e79 tempest-TestMinimumBasicScenario-1690085929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f65e7344-4e5e-49b2-9bb5-d45a97744e79 tempest-TestMinimumBasicScenario-1690085929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f65e7344-4e5e-49b2-9bb5-d45a97744e79 tempest-TestMinimumBasicScenario-1690085929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f65e7344-4e5e-49b2-9bb5-d45a97744e79 tempest-TestMinimumBasicScenario-1690085929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f65e7344-4e5e-49b2-9bb5-d45a97744e79 tempest-TestMinimumBasicScenario-1690085929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:14 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:05:14 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:14 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f65e7344-4e5e-49b2-9bb5-d45a97744e79 tempest-TestMinimumBasicScenario-1690085929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.258s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:14 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-f65e7344-4e5e-49b2-9bb5-d45a97744e79 tempest-TestMinimumBasicScenario-1690085929 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:14 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-f65e7344-4e5e-49b2-9bb5-d45a97744e79 tempest-TestMinimumBasicScenario-1690085929 None] Deleted volume successfully. Sep 01 02:05:14 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f65e7344-4e5e-49b2-9bb5-d45a97744e79 tempest-TestMinimumBasicScenario-1690085929 None] Lock "cinder-264c87a9-4e19-4b96-bfaa-d7d9384e0cca-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:15 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-71651424-6975-49ef-a9df-189a1ffc94a5 tempest-AttachVolumeTestJSON-602593005 None] Acquiring lock "cinder-266c10f1-66cc-463e-adc9-340db23f350b-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:15 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-71651424-6975-49ef-a9df-189a1ffc94a5 tempest-AttachVolumeTestJSON-602593005 None] Lock "cinder-266c10f1-66cc-463e-adc9-340db23f350b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:15 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-71651424-6975-49ef-a9df-189a1ffc94a5 tempest-AttachVolumeTestJSON-602593005 None] Acquiring lock "cinder-quobyte-266c10f1-66cc-463e-adc9-340db23f350b" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:15 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-71651424-6975-49ef-a9df-189a1ffc94a5 tempest-AttachVolumeTestJSON-602593005 None] Lock "cinder-quobyte-266c10f1-66cc-463e-adc9-340db23f350b" acquired by "delete_volume" :: waited 0.023s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:15 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[f317eda0-8b6b-46b9-b098-2644a74ff1f5]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-71651424-6975-49ef-a9df-189a1ffc94a5 tempest-AttachVolumeTestJSON-602593005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-266c10f1-66cc-463e-adc9-340db23f350b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:15 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-266c10f1-66cc-463e-adc9-340db23f350b Sep 01 02:05:15 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:16 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-71651424-6975-49ef-a9df-189a1ffc94a5 tempest-AttachVolumeTestJSON-602593005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-266c10f1-66cc-463e-adc9-340db23f350b" returned: 0 in 0.674s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-71651424-6975-49ef-a9df-189a1ffc94a5 tempest-AttachVolumeTestJSON-602593005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-266c10f1-66cc-463e-adc9-340db23f350b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:16 devstack sudo[96402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-266c10f1-66cc-463e-adc9-340db23f350b Sep 01 02:05:16 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:16 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-71651424-6975-49ef-a9df-189a1ffc94a5 tempest-AttachVolumeTestJSON-602593005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-266c10f1-66cc-463e-adc9-340db23f350b" returned: 0 in 0.417s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:16 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-71651424-6975-49ef-a9df-189a1ffc94a5 tempest-AttachVolumeTestJSON-602593005 None] Lock "cinder-quobyte-266c10f1-66cc-463e-adc9-340db23f350b" released by "delete_volume" :: held 1.160s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:16 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-71651424-6975-49ef-a9df-189a1ffc94a5 tempest-AttachVolumeTestJSON-602593005 None] Created reservations ['9a93f20f-cc46-43cf-bac7-fbddee1d744c', 'dc859577-aaba-4af1-b868-cc404e3f99cc', 'eda0a28c-4a98-4b94-8d32-6a57a8671939', '4c830c95-e4be-4f86-97e7-2323c6bf0878'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:05:16 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:05:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:16 devstack sudo[96405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:05:17 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] Flow 'volume_create_manager' (48bf4c24-41ec-481e-8193-35b300974a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2301c52-1279-417b-a167-739c27a69368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2301c52-1279-417b-a167-739c27a69368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1766324800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb6474a4-d460-4526-a731-b13243564f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f97e230d7bef4d12ad7060960cfe5cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:17Z,use_quota=True,user_id='97752354ff134faaa3b606ac49d6275f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34df60ba-4b31-4025-9f41-31cfd78a62c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34df60ba-4b31-4025-9f41-31cfd78a62c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8401f0a-b4d0-4615-b4f4-cd992875322a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8401f0a-b4d0-4615-b4f4-cd992875322a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb6474a4-d460-4526-a731-b13243564f33', 'volume_name': 'volume-cb6474a4-d460-4526-a731-b13243564f33', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2207b18a-edec-481e-8661-f5f178e457c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2207b18a-edec-481e-8661-f5f178e457c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a36413ca-291d-4e5c-a53d-da6bbf117f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:17 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] Volume cb6474a4-d460-4526-a731-b13243564f33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb6474a4-d460-4526-a731-b13243564f33', 'volume_size': 1} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1766324800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb6474a4-d460-4526-a731-b13243564f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f97e230d7bef4d12ad7060960cfe5cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:17Z,use_quota=True,user_id='97752354ff134faaa3b606ac49d6275f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] Creating volume cb6474a4-d460-4526-a731-b13243564f33 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:05:17 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cb6474a4-d460-4526-a731-b13243564f33 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:17 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cb6474a4-d460-4526-a731-b13243564f33 1073741824 Sep 01 02:05:17 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-71651424-6975-49ef-a9df-189a1ffc94a5 tempest-AttachVolumeTestJSON-602593005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-71651424-6975-49ef-a9df-189a1ffc94a5 tempest-AttachVolumeTestJSON-602593005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-71651424-6975-49ef-a9df-189a1ffc94a5 tempest-AttachVolumeTestJSON-602593005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-71651424-6975-49ef-a9df-189a1ffc94a5 tempest-AttachVolumeTestJSON-602593005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-71651424-6975-49ef-a9df-189a1ffc94a5 tempest-AttachVolumeTestJSON-602593005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-71651424-6975-49ef-a9df-189a1ffc94a5 tempest-AttachVolumeTestJSON-602593005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:17 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.326s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager._thread_info {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread count: 28 {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread info: [<_MainThread(MainThread, started 128688016527488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:05:17 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:05:17 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:17 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-71651424-6975-49ef-a9df-189a1ffc94a5 tempest-AttachVolumeTestJSON-602593005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.383s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-71651424-6975-49ef-a9df-189a1ffc94a5 tempest-AttachVolumeTestJSON-602593005 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:17 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-71651424-6975-49ef-a9df-189a1ffc94a5 tempest-AttachVolumeTestJSON-602593005 None] Deleted volume successfully. Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-71651424-6975-49ef-a9df-189a1ffc94a5 tempest-AttachVolumeTestJSON-602593005 None] Lock "cinder-266c10f1-66cc-463e-adc9-340db23f350b-delete_volume" released by "delete_volume" :: held 2.104s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7a0cd1ac-b5a5-4911-8dc9-72d9e89c971a tempest-AttachVolumeTestJSON-602593005 None] Acquiring lock "cinder-c04e46c9-2d70-4646-a534-358a3563d43f-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:17 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7a0cd1ac-b5a5-4911-8dc9-72d9e89c971a tempest-AttachVolumeTestJSON-602593005 None] Lock "cinder-c04e46c9-2d70-4646-a534-358a3563d43f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:18 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cb6474a4-d460-4526-a731-b13243564f33 1073741824" returned: 0 in 0.838s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:18 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7a0cd1ac-b5a5-4911-8dc9-72d9e89c971a tempest-AttachVolumeTestJSON-602593005 None] Acquiring lock "cinder-quobyte-c04e46c9-2d70-4646-a534-358a3563d43f" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:18 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7a0cd1ac-b5a5-4911-8dc9-72d9e89c971a tempest-AttachVolumeTestJSON-602593005 None] Lock "cinder-quobyte-c04e46c9-2d70-4646-a534-358a3563d43f" acquired by "delete_volume" :: waited 0.043s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cb6474a4-d460-4526-a731-b13243564f33 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:18 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d774fa-c6bd-4c41-8c92-6ea1d4c87c41]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7a0cd1ac-b5a5-4911-8dc9-72d9e89c971a tempest-AttachVolumeTestJSON-602593005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c04e46c9-2d70-4646-a534-358a3563d43f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:18 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cb6474a4-d460-4526-a731-b13243564f33 Sep 01 02:05:18 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:18 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c04e46c9-2d70-4646-a534-358a3563d43f Sep 01 02:05:18 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:18 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cb6474a4-d460-4526-a731-b13243564f33" returned: 0 in 0.376s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:05:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a36413ca-291d-4e5c-a53d-da6bbf117f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb6474a4-d460-4526-a731-b13243564f33', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cbdcf1f-936d-462e-925f-4fecc68c43c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:18 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] Volume volume-cb6474a4-d460-4526-a731-b13243564f33 (cb6474a4-d460-4526-a731-b13243564f33): created successfully Sep 01 02:05:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cbdcf1f-936d-462e-925f-4fecc68c43c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] Flow 'volume_create_manager' (48bf4c24-41ec-481e-8193-35b300974a46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:18 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-cf57d997-acd4-45de-a718-ba2bec35d8f2 tempest-AttachVolumeNegativeTest-545642174 None] Created volume successfully. Sep 01 02:05:18 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7a0cd1ac-b5a5-4911-8dc9-72d9e89c971a tempest-AttachVolumeTestJSON-602593005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c04e46c9-2d70-4646-a534-358a3563d43f" returned: 0 in 0.555s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7a0cd1ac-b5a5-4911-8dc9-72d9e89c971a tempest-AttachVolumeTestJSON-602593005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c04e46c9-2d70-4646-a534-358a3563d43f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:18 devstack sudo[96426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c04e46c9-2d70-4646-a534-358a3563d43f Sep 01 02:05:18 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:19 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7a0cd1ac-b5a5-4911-8dc9-72d9e89c971a tempest-AttachVolumeTestJSON-602593005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c04e46c9-2d70-4646-a534-358a3563d43f" returned: 0 in 0.361s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7a0cd1ac-b5a5-4911-8dc9-72d9e89c971a tempest-AttachVolumeTestJSON-602593005 None] Lock "cinder-quobyte-c04e46c9-2d70-4646-a534-358a3563d43f" released by "delete_volume" :: held 0.994s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:19 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-7a0cd1ac-b5a5-4911-8dc9-72d9e89c971a tempest-AttachVolumeTestJSON-602593005 None] Created reservations ['8ef88e0d-6929-4778-a497-51ef3e9f81a9', '93d04c56-37ce-4403-9f91-f8c132ba7e72', '4fb364d8-1ea4-400a-8c35-0d966da7a9aa', '306dc06e-479d-48ec-b8fb-4b5202112667'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:05:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7a0cd1ac-b5a5-4911-8dc9-72d9e89c971a tempest-AttachVolumeTestJSON-602593005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7a0cd1ac-b5a5-4911-8dc9-72d9e89c971a tempest-AttachVolumeTestJSON-602593005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:19 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7a0cd1ac-b5a5-4911-8dc9-72d9e89c971a tempest-AttachVolumeTestJSON-602593005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:19 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7a0cd1ac-b5a5-4911-8dc9-72d9e89c971a tempest-AttachVolumeTestJSON-602593005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7a0cd1ac-b5a5-4911-8dc9-72d9e89c971a tempest-AttachVolumeTestJSON-602593005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7a0cd1ac-b5a5-4911-8dc9-72d9e89c971a tempest-AttachVolumeTestJSON-602593005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:19 devstack sudo[96432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:05:19 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:19 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7a0cd1ac-b5a5-4911-8dc9-72d9e89c971a tempest-AttachVolumeTestJSON-602593005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.392s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:19 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-7a0cd1ac-b5a5-4911-8dc9-72d9e89c971a tempest-AttachVolumeTestJSON-602593005 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:19 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-7a0cd1ac-b5a5-4911-8dc9-72d9e89c971a tempest-AttachVolumeTestJSON-602593005 None] Deleted volume successfully. Sep 01 02:05:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7a0cd1ac-b5a5-4911-8dc9-72d9e89c971a tempest-AttachVolumeTestJSON-602593005 None] Lock "cinder-c04e46c9-2d70-4646-a534-358a3563d43f-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-8fca4d1c-808b-4d49-9305-79b193f99174 req-90609c42-16bf-4353-ae24-5a139d039e28 tempest-AttachVolumeNegativeTest-545642174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-8fca4d1c-808b-4d49-9305-79b193f99174 req-90609c42-16bf-4353-ae24-5a139d039e28 tempest-AttachVolumeNegativeTest-545642174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-8fca4d1c-808b-4d49-9305-79b193f99174 req-90609c42-16bf-4353-ae24-5a139d039e28 tempest-AttachVolumeNegativeTest-545642174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-8fca4d1c-808b-4d49-9305-79b193f99174 req-90609c42-16bf-4353-ae24-5a139d039e28 tempest-AttachVolumeNegativeTest-545642174 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb', 'name': 'volume-cb6474a4-d460-4526-a731-b13243564f33', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '51f6c4f7-82fd-4d7f-81b7-2888df2d8388', 'enforce_multipath': True} {{(pid=87128) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:05:20 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-8fca4d1c-808b-4d49-9305-79b193f99174 req-90609c42-16bf-4353-ae24-5a139d039e28 tempest-AttachVolumeNegativeTest-545642174 None] attachment_update completed successfully. Sep 01 02:05:20 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4a94831e-9559-4059-84cc-c64c7b723ebd tempest-AttachVolumeTestJSON-602593005 None] Acquiring lock "cinder-a8a0214c-db64-4fdb-b80e-bdd635af0bec-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:20 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4a94831e-9559-4059-84cc-c64c7b723ebd tempest-AttachVolumeTestJSON-602593005 None] Lock "cinder-a8a0214c-db64-4fdb-b80e-bdd635af0bec-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:20 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4a94831e-9559-4059-84cc-c64c7b723ebd tempest-AttachVolumeTestJSON-602593005 None] Acquiring lock "cinder-quobyte-a8a0214c-db64-4fdb-b80e-bdd635af0bec" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:20 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4a94831e-9559-4059-84cc-c64c7b723ebd tempest-AttachVolumeTestJSON-602593005 None] Lock "cinder-quobyte-a8a0214c-db64-4fdb-b80e-bdd635af0bec" acquired by "delete_volume" :: waited 0.038s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:20 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb077163-a56d-4256-8a8f-b2f9103b6602]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a94831e-9559-4059-84cc-c64c7b723ebd tempest-AttachVolumeTestJSON-602593005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a8a0214c-db64-4fdb-b80e-bdd635af0bec {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:20 devstack sudo[96539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a8a0214c-db64-4fdb-b80e-bdd635af0bec Sep 01 02:05:20 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:21 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a94831e-9559-4059-84cc-c64c7b723ebd tempest-AttachVolumeTestJSON-602593005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a8a0214c-db64-4fdb-b80e-bdd635af0bec" returned: 0 in 0.649s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a94831e-9559-4059-84cc-c64c7b723ebd tempest-AttachVolumeTestJSON-602593005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a8a0214c-db64-4fdb-b80e-bdd635af0bec {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:21 devstack sudo[96867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a8a0214c-db64-4fdb-b80e-bdd635af0bec Sep 01 02:05:21 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:21 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a94831e-9559-4059-84cc-c64c7b723ebd tempest-AttachVolumeTestJSON-602593005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a8a0214c-db64-4fdb-b80e-bdd635af0bec" returned: 0 in 0.386s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:21 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4a94831e-9559-4059-84cc-c64c7b723ebd tempest-AttachVolumeTestJSON-602593005 None] Lock "cinder-quobyte-a8a0214c-db64-4fdb-b80e-bdd635af0bec" released by "delete_volume" :: held 1.090s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:21 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-4a94831e-9559-4059-84cc-c64c7b723ebd tempest-AttachVolumeTestJSON-602593005 None] Created reservations ['57868562-749b-4363-ab7f-21b437dac6c2', '6763a514-f584-4bef-8aeb-bce6e40a403d', '99cc2d14-7905-48ab-b9cf-f87a7c08225a', '04fda370-739c-4d56-8316-69f12f34835b'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:05:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4a94831e-9559-4059-84cc-c64c7b723ebd tempest-AttachVolumeTestJSON-602593005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4a94831e-9559-4059-84cc-c64c7b723ebd tempest-AttachVolumeTestJSON-602593005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4a94831e-9559-4059-84cc-c64c7b723ebd tempest-AttachVolumeTestJSON-602593005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4a94831e-9559-4059-84cc-c64c7b723ebd tempest-AttachVolumeTestJSON-602593005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4a94831e-9559-4059-84cc-c64c7b723ebd tempest-AttachVolumeTestJSON-602593005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a94831e-9559-4059-84cc-c64c7b723ebd tempest-AttachVolumeTestJSON-602593005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:21 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:05:21 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:22 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a94831e-9559-4059-84cc-c64c7b723ebd tempest-AttachVolumeTestJSON-602593005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.338s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:22 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-4a94831e-9559-4059-84cc-c64c7b723ebd tempest-AttachVolumeTestJSON-602593005 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:22 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-4a94831e-9559-4059-84cc-c64c7b723ebd tempest-AttachVolumeTestJSON-602593005 None] Deleted volume successfully. Sep 01 02:05:22 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4a94831e-9559-4059-84cc-c64c7b723ebd tempest-AttachVolumeTestJSON-602593005 None] Lock "cinder-a8a0214c-db64-4fdb-b80e-bdd635af0bec-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:23 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-cd70e465-d9e5-46d9-bb9b-0525d2050b66 req-1092f97b-771d-43f2-8bde-aa9e6140b4bd tempest-AttachVolumeNegativeTest-545642174 None] Terminate volume connection completed successfully. Sep 01 02:05:23 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-cd70e465-d9e5-46d9-bb9b-0525d2050b66 req-1092f97b-771d-43f2-8bde-aa9e6140b4bd tempest-AttachVolumeNegativeTest-545642174 None] Deleting attachment 51f6c4f7-82fd-4d7f-81b7-2888df2d8388. {{(pid=87128) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:05:31 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:05:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] Flow 'volume_create_manager' (5ef17b49-f71a-44a9-b1e1-4a3d5e4c6372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3189e426-b23a-4166-9f20-0a201f9e4ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3189e426-b23a-4166-9f20-0a201f9e4ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-657952718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=612eba68-bcab-4bf6-a828-c2ea50d95589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89af038c103e418da0073c0583f277eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:32Z,use_quota=True,user_id='9d85e902eb9b4515b2956a56e142d908',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55829360-a26b-4857-bd27-5cd1ed9fb292),volume_type_id=55829360-a26b-4857-bd27-5cd1ed9fb292)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de40e84d-af06-42a5-8aa9-22ba93a8daac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de40e84d-af06-42a5-8aa9-22ba93a8daac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c180c3-891e-4548-a0db-c6de4f93c759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c180c3-891e-4548-a0db-c6de4f93c759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '612eba68-bcab-4bf6-a828-c2ea50d95589', 'volume_name': 'volume-612eba68-bcab-4bf6-a828-c2ea50d95589', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f835cc19-585c-4136-9c99-c56cfa2cefcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f835cc19-585c-4136-9c99-c56cfa2cefcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3803fdc7-613e-4a8a-b78a-8b1554bd13d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:31 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] Volume 612eba68-bcab-4bf6-a828-c2ea50d95589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-612eba68-bcab-4bf6-a828-c2ea50d95589', 'volume_size': 1} Sep 01 02:05:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:31 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-657952718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=612eba68-bcab-4bf6-a828-c2ea50d95589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89af038c103e418da0073c0583f277eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:32Z,use_quota=True,user_id='9d85e902eb9b4515b2956a56e142d908',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55829360-a26b-4857-bd27-5cd1ed9fb292),volume_type_id=55829360-a26b-4857-bd27-5cd1ed9fb292)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:05:31 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] Creating volume 612eba68-bcab-4bf6-a828-c2ea50d95589 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:05:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:31 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:31 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:31 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:05:31 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:05:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-612eba68-bcab-4bf6-a828-c2ea50d95589 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:31 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-612eba68-bcab-4bf6-a828-c2ea50d95589 1073741824 Sep 01 02:05:31 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:32 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:05:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] Flow 'volume_create_manager' (7d5adbf7-77af-43a7-b6b7-aa171515ef4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c2fac43-3a20-49b3-b0ea-7596de12e2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c2fac43-3a20-49b3-b0ea-7596de12e2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1895461415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d69fdbe-18c4-4e1d-8c82-eea20f6835c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89af038c103e418da0073c0583f277eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:32Z,use_quota=True,user_id='9d85e902eb9b4515b2956a56e142d908',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1bb560dd-5a38-47c5-84bf-645690e3b5ac),volume_type_id=1bb560dd-5a38-47c5-84bf-645690e3b5ac)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e1708e1-d036-4a6c-badf-e49c7e728707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e1708e1-d036-4a6c-badf-e49c7e728707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79a01569-be3e-4194-aee8-b09153ec767b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79a01569-be3e-4194-aee8-b09153ec767b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d69fdbe-18c4-4e1d-8c82-eea20f6835c8', 'volume_name': 'volume-7d69fdbe-18c4-4e1d-8c82-eea20f6835c8', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ca655b-d8c1-4198-834a-cfd7e10456a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ca655b-d8c1-4198-834a-cfd7e10456a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7083e93b-43d8-4fa7-8448-bfb49b42088d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:32 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] Volume 7d69fdbe-18c4-4e1d-8c82-eea20f6835c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d69fdbe-18c4-4e1d-8c82-eea20f6835c8', 'volume_size': 1} Sep 01 02:05:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:32 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-612eba68-bcab-4bf6-a828-c2ea50d95589 1073741824" returned: 0 in 0.744s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-612eba68-bcab-4bf6-a828-c2ea50d95589 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:32 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-612eba68-bcab-4bf6-a828-c2ea50d95589 Sep 01 02:05:32 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:33 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-612eba68-bcab-4bf6-a828-c2ea50d95589" returned: 0 in 0.320s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:05:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.442s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1895461415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d69fdbe-18c4-4e1d-8c82-eea20f6835c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89af038c103e418da0073c0583f277eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:32Z,use_quota=True,user_id='9d85e902eb9b4515b2956a56e142d908',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1bb560dd-5a38-47c5-84bf-645690e3b5ac),volume_type_id=1bb560dd-5a38-47c5-84bf-645690e3b5ac)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:05:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] Creating volume 7d69fdbe-18c4-4e1d-8c82-eea20f6835c8 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:05:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:05:33 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:05:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7d69fdbe-18c4-4e1d-8c82-eea20f6835c8 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3803fdc7-613e-4a8a-b78a-8b1554bd13d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-612eba68-bcab-4bf6-a828-c2ea50d95589', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:33 devstack sudo[96948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7d69fdbe-18c4-4e1d-8c82-eea20f6835c8 1073741824 Sep 01 02:05:33 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b897ee-b31b-4283-a7fb-b66389fc3945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:33 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] Volume volume-612eba68-bcab-4bf6-a828-c2ea50d95589 (612eba68-bcab-4bf6-a828-c2ea50d95589): created successfully Sep 01 02:05:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b897ee-b31b-4283-a7fb-b66389fc3945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] Flow 'volume_create_manager' (5ef17b49-f71a-44a9-b1e1-4a3d5e4c6372) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:33 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-6dbdf712-9b89-4a66-a0b2-ef890da30cf4 tempest-TestInstancesWithCinderVolumes-1326876574 None] Created volume successfully. Sep 01 02:05:33 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:05:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Flow 'volume_create_manager' (776bff65-a6bd-401d-aedf-1955cb49a21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e4d2a5-8d21-464b-985a-43a77d1a5190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e4d2a5-8d21-464b-985a-43a77d1a5190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-122352793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd14f2c-8ae2-4d73-b309-858fe0df8c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89af038c103e418da0073c0583f277eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:33Z,use_quota=True,user_id='9d85e902eb9b4515b2956a56e142d908',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2812f881-451a-4caa-867c-d96a89dfc550),volume_type_id=2812f881-451a-4caa-867c-d96a89dfc550)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb1b1654-749b-47d4-b915-771bc572cd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb1b1654-749b-47d4-b915-771bc572cd68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc7eef6c-e0ff-463b-9d5b-a35ada9ce168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:33 devstack cinder-volume[87128]: DEBUG cinder.image.glance [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Creating Keystone auth plugin from conf {{(pid=87128) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:05:33 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7d69fdbe-18c4-4e1d-8c82-eea20f6835c8 1073741824" returned: 0 in 0.686s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7d69fdbe-18c4-4e1d-8c82-eea20f6835c8 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:33 devstack sudo[96953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7d69fdbe-18c4-4e1d-8c82-eea20f6835c8 Sep 01 02:05:33 devstack sudo[96953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:34 devstack sudo[96953]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7d69fdbe-18c4-4e1d-8c82-eea20f6835c8" returned: 0 in 0.353s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:34 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:05:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7083e93b-43d8-4fa7-8448-bfb49b42088d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d69fdbe-18c4-4e1d-8c82-eea20f6835c8', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb22bd4-e71d-41e6-bb75-9798ff5784f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6aafacf2-b491-4c89-b60f-0a1f9a112a2f tempest-AttachVolumeNegativeTest-545642174 None] Acquiring lock "cinder-cb6474a4-d460-4526-a731-b13243564f33-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:34 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] Volume volume-7d69fdbe-18c4-4e1d-8c82-eea20f6835c8 (7d69fdbe-18c4-4e1d-8c82-eea20f6835c8): created successfully Sep 01 02:05:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb22bd4-e71d-41e6-bb75-9798ff5784f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] Flow 'volume_create_manager' (7d5adbf7-77af-43a7-b6b7-aa171515ef4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6aafacf2-b491-4c89-b60f-0a1f9a112a2f tempest-AttachVolumeNegativeTest-545642174 None] Lock "cinder-cb6474a4-d460-4526-a731-b13243564f33-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:34 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-64af6bf0-ca99-41ab-92d3-7b5197aeece2 tempest-TestInstancesWithCinderVolumes-1326876574 None] Created volume successfully. Sep 01 02:05:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6aafacf2-b491-4c89-b60f-0a1f9a112a2f tempest-AttachVolumeNegativeTest-545642174 None] Acquiring lock "cinder-quobyte-cb6474a4-d460-4526-a731-b13243564f33" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6aafacf2-b491-4c89-b60f-0a1f9a112a2f tempest-AttachVolumeNegativeTest-545642174 None] Lock "cinder-quobyte-cb6474a4-d460-4526-a731-b13243564f33" acquired by "delete_volume" :: waited 0.035s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:34 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9689c0-936f-4a57-84b5-3a5bc2fcf482]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6aafacf2-b491-4c89-b60f-0a1f9a112a2f tempest-AttachVolumeNegativeTest-545642174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cb6474a4-d460-4526-a731-b13243564f33 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc7eef6c-e0ff-463b-9d5b-a35ada9ce168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4bd14f2c-8ae2-4d73-b309-858fe0df8c84', 'volume_name': 'volume-4bd14f2c-8ae2-4d73-b309-858fe0df8c84', 'volume_size': 1, 'image_id': 'a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--714393626', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '89af038c103e418da0073c0583f277eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82', 'created_at': datetime.datetime(2026, 9, 1, 0, 5, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 5, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82/file', 'properties': {}}, 'image_service': }' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b808a4d-f527-4373-96cf-44255add1717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b808a4d-f527-4373-96cf-44255add1717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc601ea-bca5-4a26-a256-8b95b2240db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:34 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Volume 4bd14f2c-8ae2-4d73-b309-858fe0df8c84: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4bd14f2c-8ae2-4d73-b309-858fe0df8c84', 'volume_size': 1, 'image_id': 'a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--714393626', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '89af038c103e418da0073c0583f277eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82', 'created_at': datetime.datetime(2026, 9, 1, 0, 5, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 5, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82/file', 'properties': {}}, 'image_service': } Sep 01 02:05:34 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Trying to clone 4bd14f2c-8ae2-4d73-b309-858fe0df8c84 from image a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82', 'metadata': {}}]). {{(pid=87128) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:05:34 devstack sudo[96956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cb6474a4-d460-4526-a731-b13243564f33 Sep 01 02:05:34 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:34 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6aafacf2-b491-4c89-b60f-0a1f9a112a2f tempest-AttachVolumeNegativeTest-545642174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cb6474a4-d460-4526-a731-b13243564f33" returned: 0 in 0.466s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6aafacf2-b491-4c89-b60f-0a1f9a112a2f tempest-AttachVolumeNegativeTest-545642174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cb6474a4-d460-4526-a731-b13243564f33 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:35 devstack sudo[96962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cb6474a4-d460-4526-a731-b13243564f33 Sep 01 02:05:35 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:35 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6aafacf2-b491-4c89-b60f-0a1f9a112a2f tempest-AttachVolumeNegativeTest-545642174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cb6474a4-d460-4526-a731-b13243564f33" returned: 0 in 0.362s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6aafacf2-b491-4c89-b60f-0a1f9a112a2f tempest-AttachVolumeNegativeTest-545642174 None] Lock "cinder-quobyte-cb6474a4-d460-4526-a731-b13243564f33" released by "delete_volume" :: held 0.911s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:35 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-6aafacf2-b491-4c89-b60f-0a1f9a112a2f tempest-AttachVolumeNegativeTest-545642174 None] Created reservations ['ed4f0c2d-36e2-4cae-88bf-71bfea9ba05e', '23456911-ac80-4ea3-ab72-879b3e400046', '17cbdbb3-fc04-4d6f-9f7c-f0efbc4cfc25', '20b824a1-dd77-47f2-a506-cb203efe94fe'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:05:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6aafacf2-b491-4c89-b60f-0a1f9a112a2f tempest-AttachVolumeNegativeTest-545642174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6aafacf2-b491-4c89-b60f-0a1f9a112a2f tempest-AttachVolumeNegativeTest-545642174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:35 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-6aafacf2-b491-4c89-b60f-0a1f9a112a2f tempest-AttachVolumeNegativeTest-545642174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:35 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-6aafacf2-b491-4c89-b60f-0a1f9a112a2f tempest-AttachVolumeNegativeTest-545642174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6aafacf2-b491-4c89-b60f-0a1f9a112a2f tempest-AttachVolumeNegativeTest-545642174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6aafacf2-b491-4c89-b60f-0a1f9a112a2f tempest-AttachVolumeNegativeTest-545642174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:35 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:05:35 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:35 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6aafacf2-b491-4c89-b60f-0a1f9a112a2f tempest-AttachVolumeNegativeTest-545642174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.270s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:35 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-6aafacf2-b491-4c89-b60f-0a1f9a112a2f tempest-AttachVolumeNegativeTest-545642174 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:35 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-6aafacf2-b491-4c89-b60f-0a1f9a112a2f tempest-AttachVolumeNegativeTest-545642174 None] Deleted volume successfully. Sep 01 02:05:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6aafacf2-b491-4c89-b60f-0a1f9a112a2f tempest-AttachVolumeNegativeTest-545642174 None] Lock "cinder-cb6474a4-d460-4526-a731-b13243564f33-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4b9b8736-18ad-477b-959f-5ce3c19fab92 tempest-AttachVolumeNegativeTest-545642174 None] Acquiring lock "cinder-e5f74a07-17fb-469d-a908-d4b3291b804d-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4b9b8736-18ad-477b-959f-5ce3c19fab92 tempest-AttachVolumeNegativeTest-545642174 None] Lock "cinder-e5f74a07-17fb-469d-a908-d4b3291b804d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4b9b8736-18ad-477b-959f-5ce3c19fab92 tempest-AttachVolumeNegativeTest-545642174 None] Acquiring lock "cinder-quobyte-e5f74a07-17fb-469d-a908-d4b3291b804d" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4b9b8736-18ad-477b-959f-5ce3c19fab92 tempest-AttachVolumeNegativeTest-545642174 None] Lock "cinder-quobyte-e5f74a07-17fb-469d-a908-d4b3291b804d" acquired by "delete_volume" :: waited 0.030s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:36 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8e644c-44b3-4ba0-88b8-6bc4b6a1f310]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4b9b8736-18ad-477b-959f-5ce3c19fab92 tempest-AttachVolumeNegativeTest-545642174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e5f74a07-17fb-469d-a908-d4b3291b804d {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:37 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e5f74a07-17fb-469d-a908-d4b3291b804d Sep 01 02:05:37 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:37 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4b9b8736-18ad-477b-959f-5ce3c19fab92 tempest-AttachVolumeNegativeTest-545642174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e5f74a07-17fb-469d-a908-d4b3291b804d" returned: 0 in 0.487s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4b9b8736-18ad-477b-959f-5ce3c19fab92 tempest-AttachVolumeNegativeTest-545642174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e5f74a07-17fb-469d-a908-d4b3291b804d {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:37 devstack sudo[96973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e5f74a07-17fb-469d-a908-d4b3291b804d Sep 01 02:05:37 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:37 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4b9b8736-18ad-477b-959f-5ce3c19fab92 tempest-AttachVolumeNegativeTest-545642174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e5f74a07-17fb-469d-a908-d4b3291b804d" returned: 0 in 0.317s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:37 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4b9b8736-18ad-477b-959f-5ce3c19fab92 tempest-AttachVolumeNegativeTest-545642174 None] Lock "cinder-quobyte-e5f74a07-17fb-469d-a908-d4b3291b804d" released by "delete_volume" :: held 0.856s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:37 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-4b9b8736-18ad-477b-959f-5ce3c19fab92 tempest-AttachVolumeNegativeTest-545642174 None] Created reservations ['01623a4e-9b82-4f60-b49e-ae0ce54d9310', '7662d2dd-1c16-421b-a29c-eabf8bbe33a5', '4c722de7-4667-45d5-b684-8760dad1370e', '928a1abd-bcd5-46b4-8565-ab919feef4f2'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:05:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4b9b8736-18ad-477b-959f-5ce3c19fab92 tempest-AttachVolumeNegativeTest-545642174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4b9b8736-18ad-477b-959f-5ce3c19fab92 tempest-AttachVolumeNegativeTest-545642174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:37 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4b9b8736-18ad-477b-959f-5ce3c19fab92 tempest-AttachVolumeNegativeTest-545642174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:37 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4b9b8736-18ad-477b-959f-5ce3c19fab92 tempest-AttachVolumeNegativeTest-545642174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4b9b8736-18ad-477b-959f-5ce3c19fab92 tempest-AttachVolumeNegativeTest-545642174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4b9b8736-18ad-477b-959f-5ce3c19fab92 tempest-AttachVolumeNegativeTest-545642174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:37 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:05:37 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-276a6d8a-0015-469e-ab19-8ca2fee0c5a6 tempest-AttachVolumeNegativeTest-545642174 None] Acquiring lock "cinder-ae8db6d3-20e0-4625-814e-2b35661e25f0-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-276a6d8a-0015-469e-ab19-8ca2fee0c5a6 tempest-AttachVolumeNegativeTest-545642174 None] Lock "cinder-ae8db6d3-20e0-4625-814e-2b35661e25f0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-276a6d8a-0015-469e-ab19-8ca2fee0c5a6 tempest-AttachVolumeNegativeTest-545642174 None] Acquiring lock "cinder-quobyte-ae8db6d3-20e0-4625-814e-2b35661e25f0" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-276a6d8a-0015-469e-ab19-8ca2fee0c5a6 tempest-AttachVolumeNegativeTest-545642174 None] Lock "cinder-quobyte-ae8db6d3-20e0-4625-814e-2b35661e25f0" acquired by "delete_volume" :: waited 0.025s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:38 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4b9b8736-18ad-477b-959f-5ce3c19fab92 tempest-AttachVolumeNegativeTest-545642174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.545s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-4b9b8736-18ad-477b-959f-5ce3c19fab92 tempest-AttachVolumeNegativeTest-545642174 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f530c1a-78bf-41ec-8e5e-302b5dde3fa8]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-276a6d8a-0015-469e-ab19-8ca2fee0c5a6 tempest-AttachVolumeNegativeTest-545642174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae8db6d3-20e0-4625-814e-2b35661e25f0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:38 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-4b9b8736-18ad-477b-959f-5ce3c19fab92 tempest-AttachVolumeNegativeTest-545642174 None] Deleted volume successfully. Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] Flow 'volume_create_manager' (109b4985-e271-490c-b8cb-099585063a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90cf9727-3f62-4e72-9b18-45f7b4fd714f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90cf9727-3f62-4e72-9b18-45f7b4fd714f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1747216929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbee9ba6-cf13-43b1-982b-f72db5c5806f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fa74e2dff08f408597d1d970b8f1a87b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:38Z,use_quota=True,user_id='d65b9c1ab6434c5aa90a2d4f3235ec87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346176d0-7de4-4ba7-bedf-6119346d1374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346176d0-7de4-4ba7-bedf-6119346d1374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14edffeb-843d-4a23-9bed-1bc75e25c9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14edffeb-843d-4a23-9bed-1bc75e25c9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbee9ba6-cf13-43b1-982b-f72db5c5806f', 'volume_name': 'volume-cbee9ba6-cf13-43b1-982b-f72db5c5806f', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07acc296-48a9-4e5f-a9e0-4e3d08d41fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07acc296-48a9-4e5f-a9e0-4e3d08d41fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d1f874-5da4-46b2-8d55-f89df3eedf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:38 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae8db6d3-20e0-4625-814e-2b35661e25f0 Sep 01 02:05:38 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:38 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] Volume cbee9ba6-cf13-43b1-982b-f72db5c5806f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbee9ba6-cf13-43b1-982b-f72db5c5806f', 'volume_size': 1} Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1747216929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbee9ba6-cf13-43b1-982b-f72db5c5806f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fa74e2dff08f408597d1d970b8f1a87b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:38Z,use_quota=True,user_id='d65b9c1ab6434c5aa90a2d4f3235ec87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] Creating volume cbee9ba6-cf13-43b1-982b-f72db5c5806f {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:05:38 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cbee9ba6-cf13-43b1-982b-f72db5c5806f 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4b9b8736-18ad-477b-959f-5ce3c19fab92 tempest-AttachVolumeNegativeTest-545642174 None] Lock "cinder-e5f74a07-17fb-469d-a908-d4b3291b804d-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:38 devstack sudo[96981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cbee9ba6-cf13-43b1-982b-f72db5c5806f 1073741824 Sep 01 02:05:38 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:38 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-276a6d8a-0015-469e-ab19-8ca2fee0c5a6 tempest-AttachVolumeNegativeTest-545642174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae8db6d3-20e0-4625-814e-2b35661e25f0" returned: 0 in 0.444s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-276a6d8a-0015-469e-ab19-8ca2fee0c5a6 tempest-AttachVolumeNegativeTest-545642174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae8db6d3-20e0-4625-814e-2b35661e25f0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:38 devstack sudo[96990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae8db6d3-20e0-4625-814e-2b35661e25f0 Sep 01 02:05:38 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:39 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cbee9ba6-cf13-43b1-982b-f72db5c5806f 1073741824" returned: 0 in 0.624s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:39 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-276a6d8a-0015-469e-ab19-8ca2fee0c5a6 tempest-AttachVolumeNegativeTest-545642174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae8db6d3-20e0-4625-814e-2b35661e25f0" returned: 0 in 0.351s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cbee9ba6-cf13-43b1-982b-f72db5c5806f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:39 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-276a6d8a-0015-469e-ab19-8ca2fee0c5a6 tempest-AttachVolumeNegativeTest-545642174 None] Lock "cinder-quobyte-ae8db6d3-20e0-4625-814e-2b35661e25f0" released by "delete_volume" :: held 0.890s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:39 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cbee9ba6-cf13-43b1-982b-f72db5c5806f Sep 01 02:05:39 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:39 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-276a6d8a-0015-469e-ab19-8ca2fee0c5a6 tempest-AttachVolumeNegativeTest-545642174 None] Created reservations ['7b6906a4-62a7-4baa-82a2-746e2e5d8089', '7433d94f-43c5-45f7-95dc-30f4f41581c0', '195f5b30-dd05-46bb-835e-c416cb908441', '6d05490a-dc01-41ed-a419-80fd8fcc39d9'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:05:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-276a6d8a-0015-469e-ab19-8ca2fee0c5a6 tempest-AttachVolumeNegativeTest-545642174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-276a6d8a-0015-469e-ab19-8ca2fee0c5a6 tempest-AttachVolumeNegativeTest-545642174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:39 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-276a6d8a-0015-469e-ab19-8ca2fee0c5a6 tempest-AttachVolumeNegativeTest-545642174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:39 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-276a6d8a-0015-469e-ab19-8ca2fee0c5a6 tempest-AttachVolumeNegativeTest-545642174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-276a6d8a-0015-469e-ab19-8ca2fee0c5a6 tempest-AttachVolumeNegativeTest-545642174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-276a6d8a-0015-469e-ab19-8ca2fee0c5a6 tempest-AttachVolumeNegativeTest-545642174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:39 devstack sudo[96998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:05:39 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:39 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cbee9ba6-cf13-43b1-982b-f72db5c5806f" returned: 0 in 0.428s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:39 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:05:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d1f874-5da4-46b2-8d55-f89df3eedf7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbee9ba6-cf13-43b1-982b-f72db5c5806f', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d996d100-4bd5-45cc-a475-76e226844b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:39 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] Volume volume-cbee9ba6-cf13-43b1-982b-f72db5c5806f (cbee9ba6-cf13-43b1-982b-f72db5c5806f): created successfully Sep 01 02:05:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d996d100-4bd5-45cc-a475-76e226844b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] Flow 'volume_create_manager' (109b4985-e271-490c-b8cb-099585063a3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:39 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-c2caf045-5256-4826-bc95-e448700acedf req-4ff73576-dac5-48f0-9fb8-29df1e355470 tempest-VolumesGetTestJSON-705992665 None] Created volume successfully. Sep 01 02:05:39 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82_z_50o7scdevstack@QuobyteHD, size 20.69 MB, duration 5.26 sec {{(pid=87128) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:05:39 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Image download 20.69 MB at 3.93 MB/s Sep 01 02:05:39 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdd5d7f-396a-4982-8e9f-6d4fc0a3d8e4]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82_z_50o7scdevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:39 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-276a6d8a-0015-469e-ab19-8ca2fee0c5a6 tempest-AttachVolumeNegativeTest-545642174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.331s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:39 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-276a6d8a-0015-469e-ab19-8ca2fee0c5a6 tempest-AttachVolumeNegativeTest-545642174 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:39 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-276a6d8a-0015-469e-ab19-8ca2fee0c5a6 tempest-AttachVolumeNegativeTest-545642174 None] Deleted volume successfully. Sep 01 02:05:39 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-276a6d8a-0015-469e-ab19-8ca2fee0c5a6 tempest-AttachVolumeNegativeTest-545642174 None] Lock "cinder-ae8db6d3-20e0-4625-814e-2b35661e25f0-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:40 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82_z_50o7scdevstack@QuobyteHD Sep 01 02:05:40 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:40 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82_z_50o7scdevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:40 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Temporary image a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82 is fetched for user 9d85e902eb9b4515b2956a56e142d908. {{(pid=87128) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:05:40 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf22edd-42fb-4bdb-a934-7cd2936d24c9]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82_z_50o7scdevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:40 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82_z_50o7scdevstack@QuobyteHD Sep 01 02:05:40 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:40 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82_z_50o7scdevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:40 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-122352793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd14f2c-8ae2-4d73-b309-858fe0df8c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89af038c103e418da0073c0583f277eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:33Z,use_quota=True,user_id='9d85e902eb9b4515b2956a56e142d908',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2812f881-451a-4caa-867c-d96a89dfc550),volume_type_id=2812f881-451a-4caa-867c-d96a89dfc550)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:05:40 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Creating volume 4bd14f2c-8ae2-4d73-b309-858fe0df8c84 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:05:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:40 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:40 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:40 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:05:40 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:05:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4bd14f2c-8ae2-4d73-b309-858fe0df8c84 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:40 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4bd14f2c-8ae2-4d73-b309-858fe0df8c84 1073741824 Sep 01 02:05:40 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:41 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-7fdb9fbc-5911-4079-87a6-d6afe134d0b6 req-816a86aa-a0f6-452f-b08a-4f1e350328bb tempest-VolumesGetTestJSON-705992665 None] Acquiring lock "cinder-cbee9ba6-cf13-43b1-982b-f72db5c5806f-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:41 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-7fdb9fbc-5911-4079-87a6-d6afe134d0b6 req-816a86aa-a0f6-452f-b08a-4f1e350328bb tempest-VolumesGetTestJSON-705992665 None] Lock "cinder-cbee9ba6-cf13-43b1-982b-f72db5c5806f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:41 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-7fdb9fbc-5911-4079-87a6-d6afe134d0b6 req-816a86aa-a0f6-452f-b08a-4f1e350328bb tempest-VolumesGetTestJSON-705992665 None] Acquiring lock "cinder-quobyte-cbee9ba6-cf13-43b1-982b-f72db5c5806f" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:41 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-7fdb9fbc-5911-4079-87a6-d6afe134d0b6 req-816a86aa-a0f6-452f-b08a-4f1e350328bb tempest-VolumesGetTestJSON-705992665 None] Lock "cinder-quobyte-cbee9ba6-cf13-43b1-982b-f72db5c5806f" acquired by "delete_volume" :: waited 0.024s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:41 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ae0b50-056f-4ad6-a2cb-41f522d7d05d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-7fdb9fbc-5911-4079-87a6-d6afe134d0b6 req-816a86aa-a0f6-452f-b08a-4f1e350328bb tempest-VolumesGetTestJSON-705992665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cbee9ba6-cf13-43b1-982b-f72db5c5806f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:41 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cbee9ba6-cf13-43b1-982b-f72db5c5806f Sep 01 02:05:41 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:41 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4bd14f2c-8ae2-4d73-b309-858fe0df8c84 1073741824" returned: 0 in 0.567s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4bd14f2c-8ae2-4d73-b309-858fe0df8c84 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:41 devstack sudo[97021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4bd14f2c-8ae2-4d73-b309-858fe0df8c84 Sep 01 02:05:41 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:41 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-7fdb9fbc-5911-4079-87a6-d6afe134d0b6 req-816a86aa-a0f6-452f-b08a-4f1e350328bb tempest-VolumesGetTestJSON-705992665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cbee9ba6-cf13-43b1-982b-f72db5c5806f" returned: 0 in 0.463s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-7fdb9fbc-5911-4079-87a6-d6afe134d0b6 req-816a86aa-a0f6-452f-b08a-4f1e350328bb tempest-VolumesGetTestJSON-705992665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cbee9ba6-cf13-43b1-982b-f72db5c5806f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:41 devstack sudo[97028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cbee9ba6-cf13-43b1-982b-f72db5c5806f Sep 01 02:05:41 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:41 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4bd14f2c-8ae2-4d73-b309-858fe0df8c84" returned: 0 in 0.318s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:05:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:41 devstack cinder-volume[87128]: DEBUG cinder.volume.volume_utils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Attempting download of a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82 ((None, [{'url': 'file:///opt/stack/data/glance/images/a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82', 'metadata': {}}])) to volume 4bd14f2c-8ae2-4d73-b309-858fe0df8c84. {{(pid=87128) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:05:41 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[570199b7-9d6f-4f04-9158-c8ea6bb9bf58]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82__kr4pz2b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:41 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82__kr4pz2b Sep 01 02:05:41 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:41 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-7fdb9fbc-5911-4079-87a6-d6afe134d0b6 req-816a86aa-a0f6-452f-b08a-4f1e350328bb tempest-VolumesGetTestJSON-705992665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cbee9ba6-cf13-43b1-982b-f72db5c5806f" returned: 0 in 0.379s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:41 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-7fdb9fbc-5911-4079-87a6-d6afe134d0b6 req-816a86aa-a0f6-452f-b08a-4f1e350328bb tempest-VolumesGetTestJSON-705992665 None] Lock "cinder-quobyte-cbee9ba6-cf13-43b1-982b-f72db5c5806f" released by "delete_volume" :: held 0.889s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:42 devstack cinder-volume[87128]: DEBUG cinder.quota [req-7fdb9fbc-5911-4079-87a6-d6afe134d0b6 req-816a86aa-a0f6-452f-b08a-4f1e350328bb tempest-VolumesGetTestJSON-705992665 None] Created reservations ['53fb7553-20de-4dd7-acc4-5c6d83df0db4', '837d520a-2377-46a6-9d3f-afd4ac6d8107', '227b8900-a7aa-40e4-af52-020f4dea611e', 'ea0f864e-7cfc-4bba-a325-65da878b2478'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:05:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-7fdb9fbc-5911-4079-87a6-d6afe134d0b6 req-816a86aa-a0f6-452f-b08a-4f1e350328bb tempest-VolumesGetTestJSON-705992665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-7fdb9fbc-5911-4079-87a6-d6afe134d0b6 req-816a86aa-a0f6-452f-b08a-4f1e350328bb tempest-VolumesGetTestJSON-705992665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [req-7fdb9fbc-5911-4079-87a6-d6afe134d0b6 req-816a86aa-a0f6-452f-b08a-4f1e350328bb tempest-VolumesGetTestJSON-705992665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [req-7fdb9fbc-5911-4079-87a6-d6afe134d0b6 req-816a86aa-a0f6-452f-b08a-4f1e350328bb tempest-VolumesGetTestJSON-705992665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-7fdb9fbc-5911-4079-87a6-d6afe134d0b6 req-816a86aa-a0f6-452f-b08a-4f1e350328bb tempest-VolumesGetTestJSON-705992665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-7fdb9fbc-5911-4079-87a6-d6afe134d0b6 req-816a86aa-a0f6-452f-b08a-4f1e350328bb tempest-VolumesGetTestJSON-705992665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:42 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:05:42 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:42 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82__kr4pz2b" returned: 0 in 0.481s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82__kr4pz2b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:42 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82__kr4pz2b Sep 01 02:05:42 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:42 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-7fdb9fbc-5911-4079-87a6-d6afe134d0b6 req-816a86aa-a0f6-452f-b08a-4f1e350328bb tempest-VolumesGetTestJSON-705992665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.416s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:42 devstack cinder-volume[87128]: DEBUG cinder.manager [req-7fdb9fbc-5911-4079-87a6-d6afe134d0b6 req-816a86aa-a0f6-452f-b08a-4f1e350328bb tempest-VolumesGetTestJSON-705992665 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:42 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-7fdb9fbc-5911-4079-87a6-d6afe134d0b6 req-816a86aa-a0f6-452f-b08a-4f1e350328bb tempest-VolumesGetTestJSON-705992665 None] Deleted volume successfully. Sep 01 02:05:42 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-7fdb9fbc-5911-4079-87a6-d6afe134d0b6 req-816a86aa-a0f6-452f-b08a-4f1e350328bb tempest-VolumesGetTestJSON-705992665 None] Lock "cinder-cbee9ba6-cf13-43b1-982b-f72db5c5806f-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:42 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82__kr4pz2b" returned: 1 in 0.539s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82__kr4pz2b' failed. Not Retrying. {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:05:42 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[61107576-d70d-4ac5-96a2-7e884f39a32f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82_z_50o7scdevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:42 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82_z_50o7scdevstack@QuobyteHD Sep 01 02:05:42 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:43 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82_z_50o7scdevstack@QuobyteHD" returned: 0 in 0.446s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:43 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82 was qcow2, converting to qcow2 {{(pid=87128) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:05:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82_z_50o7scdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4bd14f2c-8ae2-4d73-b309-858fe0df8c84 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:43 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82_z_50o7scdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4bd14f2c-8ae2-4d73-b309-858fe0df8c84 Sep 01 02:05:43 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:45 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82_z_50o7scdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4bd14f2c-8ae2-4d73-b309-858fe0df8c84" returned: 0 in 2.091s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:45 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82_z_50o7scdevstack@QuobyteHD, size 112.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4bd14f2c-8ae2-4d73-b309-858fe0df8c84 {{(pid=87128) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:05:45 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Converted 112.00 MB image at 53.53 MB/s Sep 01 02:05:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4bd14f2c-8ae2-4d73-b309-858fe0df8c84 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:45 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4bd14f2c-8ae2-4d73-b309-858fe0df8c84 1G Sep 01 02:05:45 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:45 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4bd14f2c-8ae2-4d73-b309-858fe0df8c84 1G" returned: 0 in 0.388s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:45 devstack cinder-volume[87128]: DEBUG cinder.volume.volume_utils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Downloaded image a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82 ((None, [{'url': 'file:///opt/stack/data/glance/images/a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82', 'metadata': {}}])) to volume 4bd14f2c-8ae2-4d73-b309-858fe0df8c84 successfully. {{(pid=87128) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:05:45 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Temporary image a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82 for user 9d85e902eb9b4515b2956a56e142d908 is deleted. {{(pid=87128) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:05:45 devstack cinder-volume[87128]: DEBUG cinder.volume.volume_utils [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Marking volume 4bd14f2c-8ae2-4d73-b309-858fe0df8c84 as bootable. {{(pid=87128) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:05:45 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Copying metadata from image a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82 to 4bd14f2c-8ae2-4d73-b309-858fe0df8c84. {{(pid=87128) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:05:45 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Creating volume glance metadata for volume 4bd14f2c-8ae2-4d73-b309-858fe0df8c84 backed by image a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82 with: {'image_id': 'a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82', 'image_name': 'tempest-scenario-img--714393626', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87128) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:05:45 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc601ea-bca5-4a26-a256-8b95b2240db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bd14f2c-8ae2-4d73-b309-858fe0df8c84', 'volume_size': 1, 'image_id': 'a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--714393626', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '89af038c103e418da0073c0583f277eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82', 'created_at': datetime.datetime(2026, 9, 1, 0, 5, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 5, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a9a0237f-9af2-4aa5-a2d4-3bd0cdd3fc82/file', 'properties': {}}, 'image_service': }' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:45 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab5b606-1a25-4b29-ba15-248ce6047685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:45 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Volume volume-4bd14f2c-8ae2-4d73-b309-858fe0df8c84 (4bd14f2c-8ae2-4d73-b309-858fe0df8c84): created successfully Sep 01 02:05:45 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab5b606-1a25-4b29-ba15-248ce6047685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:45 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Flow 'volume_create_manager' (776bff65-a6bd-401d-aedf-1955cb49a21e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:45 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-af8c0629-a6cf-4c30-8ca0-c2d1c6550a5f tempest-TestInstancesWithCinderVolumes-1326876574 None] Created volume successfully. Sep 01 02:05:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-976ae4e0-9402-4cc3-9b51-090910e11d27 req-4c9af708-d152-463a-9c9b-2105b734bc07 tempest-TestInstancesWithCinderVolumes-1326876574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-976ae4e0-9402-4cc3-9b51-090910e11d27 req-4c9af708-d152-463a-9c9b-2105b734bc07 tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-976ae4e0-9402-4cc3-9b51-090910e11d27 req-4c9af708-d152-463a-9c9b-2105b734bc07 tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-976ae4e0-9402-4cc3-9b51-090910e11d27 req-4c9af708-d152-463a-9c9b-2105b734bc07 tempest-TestInstancesWithCinderVolumes-1326876574 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb', 'name': 'volume-4bd14f2c-8ae2-4d73-b309-858fe0df8c84', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a68c281f-7a75-48ef-ab12-ddcf438704ef', 'enforce_multipath': True} {{(pid=87128) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:05:52 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-976ae4e0-9402-4cc3-9b51-090910e11d27 req-4c9af708-d152-463a-9c9b-2105b734bc07 tempest-TestInstancesWithCinderVolumes-1326876574 None] attachment_update completed successfully. Sep 01 02:06:02 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=90,cinder:INSERT=29,cinder:UPDATE=100,cinder:DELETE=11 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:06:02 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:UPDATE=100,cinder:SELECT=96,cinder:INSERT=23,cinder:DELETE=5 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:06:03 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-d254eb11-4d8a-4662-b813-5203ec91522b tempest-GroupSnapshotsV319Test-30724332 None] Group tempest-GroupSnapshotsV319Test-Group-63452564: creating Sep 01 02:06:03 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-d254eb11-4d8a-4662-b813-5203ec91522b tempest-GroupSnapshotsV319Test-30724332 None] Group tempest-GroupSnapshotsV319Test-Group-63452564: created successfully Sep 01 02:06:03 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-d254eb11-4d8a-4662-b813-5203ec91522b tempest-GroupSnapshotsV319Test-30724332 None] Create group completed successfully. Sep 01 02:06:05 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] Flow 'volume_create_manager' (f5cd0ac1-6a9b-4e9c-aace-b3881a8b34f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05fee8c-4212-401e-a86f-6cd1cf28e4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05fee8c-4212-401e-a86f-6cd1cf28e4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1263503226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c8038b8e-64ec-417d-8b26-c9f9521f8bc8,host='devstack@QuobyteHD#QuobyteHD',id=73839a0e-261e-4378-80d9-edf0b6317024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6402499f41ec42ebbfb3004c2f611f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:06Z,use_quota=True,user_id='bf1570f5a4da49b79d183e0a6da7c2e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6031d95-352d-4bc6-8ebb-014749bd77be),volume_type_id=d6031d95-352d-4bc6-8ebb-014749bd77be)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6500e55a-eaaf-418d-a0a4-3736e33f748c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6500e55a-eaaf-418d-a0a4-3736e33f748c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7d90304-b789-4371-8fa9-e6fb1064b509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7d90304-b789-4371-8fa9-e6fb1064b509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73839a0e-261e-4378-80d9-edf0b6317024', 'volume_name': 'volume-73839a0e-261e-4378-80d9-edf0b6317024', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db5f636-f36c-4045-8ee2-1dfa8859d393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db5f636-f36c-4045-8ee2-1dfa8859d393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90fbb24f-6965-417e-b6c4-ef91e57c95a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:05 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] Volume 73839a0e-261e-4378-80d9-edf0b6317024: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73839a0e-261e-4378-80d9-edf0b6317024', 'volume_size': 1} Sep 01 02:06:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:05 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c8038b8e-64ec-417d-8b26-c9f9521f8bc8,created_at=2026-09-01T00:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1263503226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c8038b8e-64ec-417d-8b26-c9f9521f8bc8,host='devstack@QuobyteHD#QuobyteHD',id=73839a0e-261e-4378-80d9-edf0b6317024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6402499f41ec42ebbfb3004c2f611f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:06Z,use_quota=True,user_id='bf1570f5a4da49b79d183e0a6da7c2e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6031d95-352d-4bc6-8ebb-014749bd77be),volume_type_id=d6031d95-352d-4bc6-8ebb-014749bd77be)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:05 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] Creating volume 73839a0e-261e-4378-80d9-edf0b6317024 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:05 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:05 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:05 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:05 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:06:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:05 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024 1073741824 Sep 01 02:06:05 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:06 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024 1073741824" returned: 0 in 0.801s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:06 devstack sudo[97535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024 Sep 01 02:06:06 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:07 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024" returned: 0 in 0.605s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:07 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90fbb24f-6965-417e-b6c4-ef91e57c95a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73839a0e-261e-4378-80d9-edf0b6317024', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e64cfd59-ad28-483c-8963-5d05eebfdbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:07 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] Volume volume-73839a0e-261e-4378-80d9-edf0b6317024 (73839a0e-261e-4378-80d9-edf0b6317024): created successfully Sep 01 02:06:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e64cfd59-ad28-483c-8963-5d05eebfdbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] Flow 'volume_create_manager' (f5cd0ac1-6a9b-4e9c-aace-b3881a8b34f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:07 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-065e7e00-264e-4fb7-9814-0746fed95e27 tempest-GroupSnapshotsV319Test-30724332 None] Created volume successfully. Sep 01 02:06:08 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] Flow 'volume_create_manager' (a06c9302-de77-4bf1-8466-2d1ccfa0c4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4f97b28-f3f8-4571-a857-49c9510885d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4f97b28-f3f8-4571-a857-49c9510885d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1721131896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7beb78d5-8ab8-4275-9ab6-e85974d2a75f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e8daee682f14c6aa345006b7897f477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:08Z,use_quota=True,user_id='3dc3be649a3b4921878b6c47c683ed4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0453c424-38ab-4472-a7bd-36afce1fe135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0453c424-38ab-4472-a7bd-36afce1fe135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8f9979a-8983-4437-9c63-f27ad70f2f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8f9979a-8983-4437-9c63-f27ad70f2f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7beb78d5-8ab8-4275-9ab6-e85974d2a75f', 'volume_name': 'volume-7beb78d5-8ab8-4275-9ab6-e85974d2a75f', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78bbcec3-34d4-4ea1-9e96-f94379093ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78bbcec3-34d4-4ea1-9e96-f94379093ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c427008-24b8-4a94-8ad1-9cf64334620d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:08 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] Volume 7beb78d5-8ab8-4275-9ab6-e85974d2a75f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7beb78d5-8ab8-4275-9ab6-e85974d2a75f', 'volume_size': 1} Sep 01 02:06:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1721131896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7beb78d5-8ab8-4275-9ab6-e85974d2a75f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e8daee682f14c6aa345006b7897f477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:08Z,use_quota=True,user_id='3dc3be649a3b4921878b6c47c683ed4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] Creating volume 7beb78d5-8ab8-4275-9ab6-e85974d2a75f {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:08 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:06:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7beb78d5-8ab8-4275-9ab6-e85974d2a75f 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:08 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7beb78d5-8ab8-4275-9ab6-e85974d2a75f 1073741824 Sep 01 02:06:08 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:09 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7beb78d5-8ab8-4275-9ab6-e85974d2a75f 1073741824" returned: 0 in 0.941s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:09 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-04d1b734-30d6-42fa-90f6-df4caf4ac2c6 tempest-GroupSnapshotsV319Test-30724332 None] GroupSnapshot 23d55076-8dde-43ed-8cf4-356d63954d7c: creating. Sep 01 02:06:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7beb78d5-8ab8-4275-9ab6-e85974d2a75f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:09 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7beb78d5-8ab8-4275-9ab6-e85974d2a75f Sep 01 02:06:09 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-04d1b734-30d6-42fa-90f6-df4caf4ac2c6 tempest-GroupSnapshotsV319Test-30724332 None] Group snapshot 23d55076-8dde-43ed-8cf4-356d63954d7c: creating. {{(pid=87128) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 02:06:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-04d1b734-30d6-42fa-90f6-df4caf4ac2c6 tempest-GroupSnapshotsV319Test-30724332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:09 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7beb78d5-8ab8-4275-9ab6-e85974d2a75f" returned: 0 in 0.310s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:09 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-04d1b734-30d6-42fa-90f6-df4caf4ac2c6 tempest-GroupSnapshotsV319Test-30724332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.259s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c427008-24b8-4a94-8ad1-9cf64334620d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7beb78d5-8ab8-4275-9ab6-e85974d2a75f', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd16a19-c019-4bd4-bf84-acfe16cbbf7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:09 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-04d1b734-30d6-42fa-90f6-df4caf4ac2c6 tempest-GroupSnapshotsV319Test-30724332 None] Creating offline snapshot 51c7163e-eacd-4973-b9e6-1a5ad9d9ee83 of volume 73839a0e-261e-4378-80d9-edf0b6317024 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:06:09 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] Volume volume-7beb78d5-8ab8-4275-9ab6-e85974d2a75f (7beb78d5-8ab8-4275-9ab6-e85974d2a75f): created successfully Sep 01 02:06:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd16a19-c019-4bd4-bf84-acfe16cbbf7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] Flow 'volume_create_manager' (a06c9302-de77-4bf1-8466-2d1ccfa0c4ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:09 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acc6aa0-73af-4d8b-bc53-ba3a9c343005]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-04d1b734-30d6-42fa-90f6-df4caf4ac2c6 tempest-GroupSnapshotsV319Test-30724332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:09 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-867a5416-f0d5-42da-bc7e-5e5c1ca36dad tempest-VolumeQuotasAdminTestJSON-731966102 None] Created volume successfully. Sep 01 02:06:09 devstack sudo[97549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024 Sep 01 02:06:09 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:10 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-04d1b734-30d6-42fa-90f6-df4caf4ac2c6 tempest-GroupSnapshotsV319Test-30724332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024" returned: 0 in 0.599s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-04d1b734-30d6-42fa-90f6-df4caf4ac2c6 tempest-GroupSnapshotsV319Test-30724332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024.51c7163e-eacd-4973-b9e6-1a5ad9d9ee83 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:10 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024.51c7163e-eacd-4973-b9e6-1a5ad9d9ee83 1G Sep 01 02:06:10 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:10 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c1e7e2c4-d401-41e1-8b2f-11abbafa24a0 tempest-VolumeQuotasAdminTestJSON-731966102 None] Acquiring lock "cinder-7beb78d5-8ab8-4275-9ab6-e85974d2a75f-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:10 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c1e7e2c4-d401-41e1-8b2f-11abbafa24a0 tempest-VolumeQuotasAdminTestJSON-731966102 None] Lock "cinder-7beb78d5-8ab8-4275-9ab6-e85974d2a75f-delete_volume" acquired by "delete_volume" :: waited 0.141s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:10 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c1e7e2c4-d401-41e1-8b2f-11abbafa24a0 tempest-VolumeQuotasAdminTestJSON-731966102 None] Acquiring lock "cinder-quobyte-7beb78d5-8ab8-4275-9ab6-e85974d2a75f" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:10 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c1e7e2c4-d401-41e1-8b2f-11abbafa24a0 tempest-VolumeQuotasAdminTestJSON-731966102 None] Lock "cinder-quobyte-7beb78d5-8ab8-4275-9ab6-e85974d2a75f" acquired by "delete_volume" :: waited 0.025s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:10 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8f9c83-bf61-4eb4-aeb5-8567a7abbf89]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c1e7e2c4-d401-41e1-8b2f-11abbafa24a0 tempest-VolumeQuotasAdminTestJSON-731966102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7beb78d5-8ab8-4275-9ab6-e85974d2a75f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:10 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7beb78d5-8ab8-4275-9ab6-e85974d2a75f Sep 01 02:06:10 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:11 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-04d1b734-30d6-42fa-90f6-df4caf4ac2c6 tempest-GroupSnapshotsV319Test-30724332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024.51c7163e-eacd-4973-b9e6-1a5ad9d9ee83 1G" returned: 0 in 0.952s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-04d1b734-30d6-42fa-90f6-df4caf4ac2c6 tempest-GroupSnapshotsV319Test-30724332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73839a0e-261e-4378-80d9-edf0b6317024 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024.51c7163e-eacd-4973-b9e6-1a5ad9d9ee83 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:11 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73839a0e-261e-4378-80d9-edf0b6317024 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024.51c7163e-eacd-4973-b9e6-1a5ad9d9ee83 Sep 01 02:06:11 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:11 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c1e7e2c4-d401-41e1-8b2f-11abbafa24a0 tempest-VolumeQuotasAdminTestJSON-731966102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7beb78d5-8ab8-4275-9ab6-e85974d2a75f" returned: 0 in 0.722s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c1e7e2c4-d401-41e1-8b2f-11abbafa24a0 tempest-VolumeQuotasAdminTestJSON-731966102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7beb78d5-8ab8-4275-9ab6-e85974d2a75f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:11 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:11 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7beb78d5-8ab8-4275-9ab6-e85974d2a75f Sep 01 02:06:11 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Flow 'volume_create_manager' (287948e8-5d10-419a-b8a3-8e243f54f81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6d3016-24c4-4cf1-8290-2a45749af8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6d3016-24c4-4cf1-8290-2a45749af8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-110627175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c53b0b6-043a-4275-afc5-6d0e749e4977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a0e38eb3ca4e04a52b20c65b26ee47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:11Z,use_quota=True,user_id='59b983b2f7a4408ead6f119763eafeb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e906c059-7d93-4bef-a192-8e734a91e445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e906c059-7d93-4bef-a192-8e734a91e445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e97e0af-b722-4018-87ee-a3c2876afa52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:11 devstack cinder-volume[87128]: DEBUG cinder.image.glance [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Creating Keystone auth plugin from conf {{(pid=87128) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:06:11 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-04d1b734-30d6-42fa-90f6-df4caf4ac2c6 tempest-GroupSnapshotsV319Test-30724332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73839a0e-261e-4378-80d9-edf0b6317024 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024.51c7163e-eacd-4973-b9e6-1a5ad9d9ee83" returned: 0 in 0.580s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:11 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-04d1b734-30d6-42fa-90f6-df4caf4ac2c6 tempest-GroupSnapshotsV319Test-30724332 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024.51c7163e-eacd-4973-b9e6-1a5ad9d9ee83 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:06:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-04d1b734-30d6-42fa-90f6-df4caf4ac2c6 tempest-GroupSnapshotsV319Test-30724332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024.51c7163e-eacd-4973-b9e6-1a5ad9d9ee83 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:11 devstack sudo[97572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024.51c7163e-eacd-4973-b9e6-1a5ad9d9ee83 Sep 01 02:06:11 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:12 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c1e7e2c4-d401-41e1-8b2f-11abbafa24a0 tempest-VolumeQuotasAdminTestJSON-731966102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7beb78d5-8ab8-4275-9ab6-e85974d2a75f" returned: 0 in 0.470s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:12 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c1e7e2c4-d401-41e1-8b2f-11abbafa24a0 tempest-VolumeQuotasAdminTestJSON-731966102 None] Lock "cinder-quobyte-7beb78d5-8ab8-4275-9ab6-e85974d2a75f" released by "delete_volume" :: held 1.272s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:12 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-c1e7e2c4-d401-41e1-8b2f-11abbafa24a0 tempest-VolumeQuotasAdminTestJSON-731966102 None] Created reservations ['6aad96ff-5d11-44a5-941d-dfb022b486ba', '34386c7b-8e98-40e1-bffe-31b39e070bba', '9f0aa968-e9dd-49ab-bd7d-bc5360256798', '39157991-68f8-4464-a29d-e559c78b1ee2'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:12 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-04d1b734-30d6-42fa-90f6-df4caf4ac2c6 tempest-GroupSnapshotsV319Test-30724332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024.51c7163e-eacd-4973-b9e6-1a5ad9d9ee83" returned: 0 in 0.458s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-04d1b734-30d6-42fa-90f6-df4caf4ac2c6 tempest-GroupSnapshotsV319Test-30724332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c1e7e2c4-d401-41e1-8b2f-11abbafa24a0 tempest-VolumeQuotasAdminTestJSON-731966102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c1e7e2c4-d401-41e1-8b2f-11abbafa24a0 tempest-VolumeQuotasAdminTestJSON-731966102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:12 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c1e7e2c4-d401-41e1-8b2f-11abbafa24a0 tempest-VolumeQuotasAdminTestJSON-731966102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:12 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c1e7e2c4-d401-41e1-8b2f-11abbafa24a0 tempest-VolumeQuotasAdminTestJSON-731966102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c1e7e2c4-d401-41e1-8b2f-11abbafa24a0 tempest-VolumeQuotasAdminTestJSON-731966102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c1e7e2c4-d401-41e1-8b2f-11abbafa24a0 tempest-VolumeQuotasAdminTestJSON-731966102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:12 devstack sudo[97576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024.info Sep 01 02:06:12 devstack sudo[97576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:12 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:06:12 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e97e0af-b722-4018-87ee-a3c2876afa52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1c53b0b6-043a-4275-afc5-6d0e749e4977', 'volume_name': 'volume-1c53b0b6-043a-4275-afc5-6d0e749e4977', 'volume_size': 1, 'image_id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64fc298b-4656-41e6-a52e-bd149cb491e9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0dbd8f0a33a74d5db3271102e89b70d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'created_at': datetime.datetime(2026, 8, 31, 23, 51, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 51, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64fc298b-4656-41e6-a52e-bd149cb491e9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf0cdfe-4a25-469e-b936-eeda12fa4e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf0cdfe-4a25-469e-b936-eeda12fa4e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:12 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4c65a61-3755-433c-a1e5-ffc1a274afd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:12 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Volume 1c53b0b6-043a-4275-afc5-6d0e749e4977: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1c53b0b6-043a-4275-afc5-6d0e749e4977', 'volume_size': 1, 'image_id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64fc298b-4656-41e6-a52e-bd149cb491e9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0dbd8f0a33a74d5db3271102e89b70d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'created_at': datetime.datetime(2026, 8, 31, 23, 51, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 51, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64fc298b-4656-41e6-a52e-bd149cb491e9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 02:06:12 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Trying to clone 1c53b0b6-043a-4275-afc5-6d0e749e4977 from image 64fc298b-4656-41e6-a52e-bd149cb491e9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/64fc298b-4656-41e6-a52e-bd149cb491e9', 'metadata': {}}]). {{(pid=87128) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:06:12 devstack sudo[97576]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-04d1b734-30d6-42fa-90f6-df4caf4ac2c6 tempest-GroupSnapshotsV319Test-30724332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024.info" returned: 0 in 0.458s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:12 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-04d1b734-30d6-42fa-90f6-df4caf4ac2c6 tempest-GroupSnapshotsV319Test-30724332 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:06:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-04d1b734-30d6-42fa-90f6-df4caf4ac2c6 tempest-GroupSnapshotsV319Test-30724332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:12 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c1e7e2c4-d401-41e1-8b2f-11abbafa24a0 tempest-VolumeQuotasAdminTestJSON-731966102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.437s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:12 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-c1e7e2c4-d401-41e1-8b2f-11abbafa24a0 tempest-VolumeQuotasAdminTestJSON-731966102 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:12 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024.info Sep 01 02:06:12 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:12 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-c1e7e2c4-d401-41e1-8b2f-11abbafa24a0 tempest-VolumeQuotasAdminTestJSON-731966102 None] Deleted volume successfully. Sep 01 02:06:12 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c1e7e2c4-d401-41e1-8b2f-11abbafa24a0 tempest-VolumeQuotasAdminTestJSON-731966102 None] Lock "cinder-7beb78d5-8ab8-4275-9ab6-e85974d2a75f-delete_volume" released by "delete_volume" :: held 2.292s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:13 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:13 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_oc1f5ulydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87128) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:06:13 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Image download 20.69 MB at 20.69 MB/s Sep 01 02:06:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-04d1b734-30d6-42fa-90f6-df4caf4ac2c6 tempest-GroupSnapshotsV319Test-30724332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024.info" returned: 0 in 0.427s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-04d1b734-30d6-42fa-90f6-df4caf4ac2c6 tempest-GroupSnapshotsV319Test-30724332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.697s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:13 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89063bc-c98b-4669-ae70-2e564141e5d4]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_oc1f5ulydevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:13 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-04d1b734-30d6-42fa-90f6-df4caf4ac2c6 tempest-GroupSnapshotsV319Test-30724332 None] group_snapshot 23d55076-8dde-43ed-8cf4-356d63954d7c: created successfully Sep 01 02:06:13 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_oc1f5ulydevstack@QuobyteHD Sep 01 02:06:13 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:13 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_oc1f5ulydevstack@QuobyteHD" returned: 0 in 0.621s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:13 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Temporary image 64fc298b-4656-41e6-a52e-bd149cb491e9 is fetched for user 59b983b2f7a4408ead6f119763eafeb7. {{(pid=87128) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] Flow 'volume_create_manager' (39398801-761f-43d1-a0d4-27b44cbfd4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a94963e-5572-41a6-960f-2e5e12c0742f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e7d71d-d231-4f66-b5d8-a8336da24d0c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_oc1f5ulydevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a94963e-5572-41a6-960f-2e5e12c0742f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1136181746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3501af12-4a78-4900-b523-a3cbafcf9f44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e8daee682f14c6aa345006b7897f477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:14Z,use_quota=True,user_id='3dc3be649a3b4921878b6c47c683ed4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (595abec7-2c1f-41ac-b36a-7f61dfcaa519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (595abec7-2c1f-41ac-b36a-7f61dfcaa519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (470acdff-d36b-486f-a3f1-200376316261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (470acdff-d36b-486f-a3f1-200376316261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3501af12-4a78-4900-b523-a3cbafcf9f44', 'volume_name': 'volume-3501af12-4a78-4900-b523-a3cbafcf9f44', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd132d62-09cf-4d00-acec-c9f1b1e3ba5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd132d62-09cf-4d00-acec-c9f1b1e3ba5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f23a47cc-a755-47ee-af0e-66ba33d1928d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:14 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] Volume 3501af12-4a78-4900-b523-a3cbafcf9f44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3501af12-4a78-4900-b523-a3cbafcf9f44', 'volume_size': 1} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1136181746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3501af12-4a78-4900-b523-a3cbafcf9f44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e8daee682f14c6aa345006b7897f477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:14Z,use_quota=True,user_id='3dc3be649a3b4921878b6c47c683ed4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] Creating volume 3501af12-4a78-4900-b523-a3cbafcf9f44 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:14 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3501af12-4a78-4900-b523-a3cbafcf9f44 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:14 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3501af12-4a78-4900-b523-a3cbafcf9f44 1073741824 Sep 01 02:06:14 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:14 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_oc1f5ulydevstack@QuobyteHD Sep 01 02:06:14 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:14 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:14 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-cac66205-c73c-430e-890c-c819602398bb tempest-GroupSnapshotsV319Test-30724332 None] group_snapshot 23d55076-8dde-43ed-8cf4-356d63954d7c: deleting Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_oc1f5ulydevstack@QuobyteHD" returned: 0 in 0.565s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cac66205-c73c-430e-890c-c819602398bb tempest-GroupSnapshotsV319Test-30724332 None] group_snapshot 23d55076-8dde-43ed-8cf4-356d63954d7c: deleting {{(pid=87128) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-cac66205-c73c-430e-890c-c819602398bb tempest-GroupSnapshotsV319Test-30724332 None] Acquiring lock "cinder-quobyte-73839a0e-261e-4378-80d9-edf0b6317024" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-cac66205-c73c-430e-890c-c819602398bb tempest-GroupSnapshotsV319Test-30724332 None] Lock "cinder-quobyte-73839a0e-261e-4378-80d9-edf0b6317024" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-cac66205-c73c-430e-890c-c819602398bb tempest-GroupSnapshotsV319Test-30724332 None] Acquiring lock "cinder-quobyte-51c7163e-eacd-4973-b9e6-1a5ad9d9ee83" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-cac66205-c73c-430e-890c-c819602398bb tempest-GroupSnapshotsV319Test-30724332 None] Lock "cinder-quobyte-51c7163e-eacd-4973-b9e6-1a5ad9d9ee83" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-cac66205-c73c-430e-890c-c819602398bb tempest-GroupSnapshotsV319Test-30724332 None] Deleting offline snapshot 51c7163e-eacd-4973-b9e6-1a5ad9d9ee83 of volume 73839a0e-261e-4378-80d9-edf0b6317024 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-cac66205-c73c-430e-890c-c819602398bb tempest-GroupSnapshotsV319Test-30724332 None] snapshot_file for this snap is: volume-73839a0e-261e-4378-80d9-edf0b6317024.51c7163e-eacd-4973-b9e6-1a5ad9d9ee83 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a57a49e-8cc4-4adb-9bbb-3a9df7f02cf4]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cac66205-c73c-430e-890c-c819602398bb tempest-GroupSnapshotsV319Test-30724332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024.51c7163e-eacd-4973-b9e6-1a5ad9d9ee83 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:15 devstack sudo[97604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024.51c7163e-eacd-4973-b9e6-1a5ad9d9ee83 Sep 01 02:06:15 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:15 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3501af12-4a78-4900-b523-a3cbafcf9f44 1073741824" returned: 0 in 0.901s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3501af12-4a78-4900-b523-a3cbafcf9f44 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:15 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3501af12-4a78-4900-b523-a3cbafcf9f44 Sep 01 02:06:15 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:15 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cac66205-c73c-430e-890c-c819602398bb tempest-GroupSnapshotsV319Test-30724332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024.51c7163e-eacd-4973-b9e6-1a5ad9d9ee83" returned: 0 in 0.597s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:15 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-cac66205-c73c-430e-890c-c819602398bb tempest-GroupSnapshotsV319Test-30724332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73839a0e-261e-4378-80d9-edf0b6317024(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:06:15 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb609a0-4640-4774-b22e-26e1298a35e8]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cac66205-c73c-430e-890c-c819602398bb tempest-GroupSnapshotsV319Test-30724332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:15 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3501af12-4a78-4900-b523-a3cbafcf9f44" returned: 0 in 0.382s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:15 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.879s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:15 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-110627175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c53b0b6-043a-4275-afc5-6d0e749e4977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a0e38eb3ca4e04a52b20c65b26ee47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:11Z,use_quota=True,user_id='59b983b2f7a4408ead6f119763eafeb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:15 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Creating volume 1c53b0b6-043a-4275-afc5-6d0e749e4977 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:15 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:15 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:15 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:15 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:06:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1c53b0b6-043a-4275-afc5-6d0e749e4977 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:15 devstack sudo[97614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024 Sep 01 02:06:15 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:15 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1c53b0b6-043a-4275-afc5-6d0e749e4977 1073741824 Sep 01 02:06:15 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f23a47cc-a755-47ee-af0e-66ba33d1928d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3501af12-4a78-4900-b523-a3cbafcf9f44', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a4b54b0-b527-4d6c-a53e-c3f0c6159205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:15 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] Volume volume-3501af12-4a78-4900-b523-a3cbafcf9f44 (3501af12-4a78-4900-b523-a3cbafcf9f44): created successfully Sep 01 02:06:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a4b54b0-b527-4d6c-a53e-c3f0c6159205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] Flow 'volume_create_manager' (39398801-761f-43d1-a0d4-27b44cbfd4fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:15 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-a8d5ebb5-5dbe-4c6a-908b-217e78dd5f39 tempest-VolumeQuotasAdminTestJSON-731966102 None] Created volume successfully. Sep 01 02:06:15 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cac66205-c73c-430e-890c-c819602398bb tempest-GroupSnapshotsV319Test-30724332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024" returned: 0 in 0.507s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cac66205-c73c-430e-890c-c819602398bb tempest-GroupSnapshotsV319Test-30724332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024.51c7163e-eacd-4973-b9e6-1a5ad9d9ee83 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:16 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024.51c7163e-eacd-4973-b9e6-1a5ad9d9ee83 Sep 01 02:06:16 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:16 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1c53b0b6-043a-4275-afc5-6d0e749e4977 1073741824" returned: 0 in 0.576s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1c53b0b6-043a-4275-afc5-6d0e749e4977 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:16 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1c53b0b6-043a-4275-afc5-6d0e749e4977 Sep 01 02:06:16 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:16 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cac66205-c73c-430e-890c-c819602398bb tempest-GroupSnapshotsV319Test-30724332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024.51c7163e-eacd-4973-b9e6-1a5ad9d9ee83" returned: 0 in 0.396s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cac66205-c73c-430e-890c-c819602398bb tempest-GroupSnapshotsV319Test-30724332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024.51c7163e-eacd-4973-b9e6-1a5ad9d9ee83 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:16 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024.51c7163e-eacd-4973-b9e6-1a5ad9d9ee83 Sep 01 02:06:16 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:16 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1c53b0b6-043a-4275-afc5-6d0e749e4977" returned: 0 in 0.304s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:16 devstack cinder-volume[87128]: DEBUG cinder.volume.volume_utils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Attempting download of 64fc298b-4656-41e6-a52e-bd149cb491e9 ((None, [{'url': 'file:///opt/stack/data/glance/images/64fc298b-4656-41e6-a52e-bd149cb491e9', 'metadata': {}}])) to volume 1c53b0b6-043a-4275-afc5-6d0e749e4977. {{(pid=87128) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:06:16 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2132d8e-7c99-4b13-a34a-a0258363a9df]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_t07manl6 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:16 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cac66205-c73c-430e-890c-c819602398bb tempest-GroupSnapshotsV319Test-30724332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024.51c7163e-eacd-4973-b9e6-1a5ad9d9ee83" returned: 0 in 0.290s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:16 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-cac66205-c73c-430e-890c-c819602398bb tempest-GroupSnapshotsV319Test-30724332 None] Lock "cinder-quobyte-51c7163e-eacd-4973-b9e6-1a5ad9d9ee83" released by "_delete_snapshot" :: held 1.921s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:16 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-cac66205-c73c-430e-890c-c819602398bb tempest-GroupSnapshotsV319Test-30724332 None] Lock "cinder-quobyte-73839a0e-261e-4378-80d9-edf0b6317024" released by "delete_snapshot" :: held 1.957s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:16 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_t07manl6 Sep 01 02:06:16 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:16 devstack cinder-volume[87128]: WARNING cinder.quota [None req-cac66205-c73c-430e-890c-c819602398bb tempest-GroupSnapshotsV319Test-30724332 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1881984811 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1881984811, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:06:16 devstack cinder-volume[87128]: WARNING cinder.quota [None req-cac66205-c73c-430e-890c-c819602398bb tempest-GroupSnapshotsV319Test-30724332 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1881984811 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1881984811, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:06:16 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-cac66205-c73c-430e-890c-c819602398bb tempest-GroupSnapshotsV319Test-30724332 None] Created reservations ['87ea092b-3e9d-4dd9-a51a-6bde4d345416', '56eed918-232d-4f1f-b25a-5ccd2c15d44a', '3e466e02-0b2d-4f1a-9a8f-7642f4e192a6', '06019c31-51ae-4579-9330-5219ed73559c'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:16 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-d7ce7c86-ef40-4f3e-92e8-1b4d8620c024 tempest-VolumeQuotasAdminTestJSON-682675767 None] Transfer volume completed successfully. Sep 01 02:06:16 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:06:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:16 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-cac66205-c73c-430e-890c-c819602398bb tempest-GroupSnapshotsV319Test-30724332 None] group_snapshot 23d55076-8dde-43ed-8cf4-356d63954d7c: deleted successfully Sep 01 02:06:17 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:06:17 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:17 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_t07manl6" returned: 0 in 0.533s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_t07manl6 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:17 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.356s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:17 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:17 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager._thread_info {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:06:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread count: 28 {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:06:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread info: [<_MainThread(MainThread, started 128688016527488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:06:17 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_t07manl6 Sep 01 02:06:17 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:17 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9b1f8dc6-72c5-4696-b6fa-2bab9567a528 tempest-VolumeQuotasAdminTestJSON-110095171 None] Acquiring lock "cinder-3501af12-4a78-4900-b523-a3cbafcf9f44-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:17 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-dcffcbef-3dff-4da0-8a8e-14d5535eb0f3 tempest-GroupSnapshotsV319Test-30724332 None] Acquiring lock "cinder-quobyte-73839a0e-261e-4378-80d9-edf0b6317024" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:17 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9b1f8dc6-72c5-4696-b6fa-2bab9567a528 tempest-VolumeQuotasAdminTestJSON-110095171 None] Lock "cinder-3501af12-4a78-4900-b523-a3cbafcf9f44-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:17 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-dcffcbef-3dff-4da0-8a8e-14d5535eb0f3 tempest-GroupSnapshotsV319Test-30724332 None] Lock "cinder-quobyte-73839a0e-261e-4378-80d9-edf0b6317024" acquired by "delete_volume" :: waited 0.056s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:17 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_t07manl6" returned: 1 in 0.550s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_t07manl6' failed. Not Retrying. {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:06:17 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[9070d126-dee5-4f44-9409-230094ae9626]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_oc1f5ulydevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:17 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c3f07a-3d49-4c38-ba22-598aaec18583]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-dcffcbef-3dff-4da0-8a8e-14d5535eb0f3 tempest-GroupSnapshotsV319Test-30724332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:17 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9b1f8dc6-72c5-4696-b6fa-2bab9567a528 tempest-VolumeQuotasAdminTestJSON-110095171 None] Acquiring lock "cinder-quobyte-3501af12-4a78-4900-b523-a3cbafcf9f44" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:17 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9b1f8dc6-72c5-4696-b6fa-2bab9567a528 tempest-VolumeQuotasAdminTestJSON-110095171 None] Lock "cinder-quobyte-3501af12-4a78-4900-b523-a3cbafcf9f44" acquired by "delete_volume" :: waited 0.019s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:17 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[597068c8-3e8a-48ff-9a96-b9512bfedbb5]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9b1f8dc6-72c5-4696-b6fa-2bab9567a528 tempest-VolumeQuotasAdminTestJSON-110095171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3501af12-4a78-4900-b523-a3cbafcf9f44 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:17 devstack sudo[97649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_oc1f5ulydevstack@QuobyteHD Sep 01 02:06:17 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:17 devstack sudo[97650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024 Sep 01 02:06:17 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:18 devstack sudo[97651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3501af12-4a78-4900-b523-a3cbafcf9f44 Sep 01 02:06:18 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:18 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-dcffcbef-3dff-4da0-8a8e-14d5535eb0f3 tempest-GroupSnapshotsV319Test-30724332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024" returned: 0 in 0.427s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:18 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-dcffcbef-3dff-4da0-8a8e-14d5535eb0f3 tempest-GroupSnapshotsV319Test-30724332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_oc1f5ulydevstack@QuobyteHD" returned: 0 in 0.454s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:18 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] 64fc298b-4656-41e6-a52e-bd149cb491e9 was qcow2, converting to qcow2 {{(pid=87128) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:06:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_oc1f5ulydevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1c53b0b6-043a-4275-afc5-6d0e749e4977 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:18 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024 Sep 01 02:06:18 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:18 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_oc1f5ulydevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1c53b0b6-043a-4275-afc5-6d0e749e4977 Sep 01 02:06:18 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:18 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9b1f8dc6-72c5-4696-b6fa-2bab9567a528 tempest-VolumeQuotasAdminTestJSON-110095171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3501af12-4a78-4900-b523-a3cbafcf9f44" returned: 0 in 0.478s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9b1f8dc6-72c5-4696-b6fa-2bab9567a528 tempest-VolumeQuotasAdminTestJSON-110095171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3501af12-4a78-4900-b523-a3cbafcf9f44 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:18 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3501af12-4a78-4900-b523-a3cbafcf9f44 Sep 01 02:06:18 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:18 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-dcffcbef-3dff-4da0-8a8e-14d5535eb0f3 tempest-GroupSnapshotsV319Test-30724332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-73839a0e-261e-4378-80d9-edf0b6317024" returned: 0 in 0.297s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:18 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-dcffcbef-3dff-4da0-8a8e-14d5535eb0f3 tempest-GroupSnapshotsV319Test-30724332 None] Lock "cinder-quobyte-73839a0e-261e-4378-80d9-edf0b6317024" released by "delete_volume" :: held 0.810s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:18 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-dcffcbef-3dff-4da0-8a8e-14d5535eb0f3 tempest-GroupSnapshotsV319Test-30724332 None] Created reservations ['43cdd553-bd8b-44e6-98c9-c44a0363c954'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:18 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9b1f8dc6-72c5-4696-b6fa-2bab9567a528 tempest-VolumeQuotasAdminTestJSON-110095171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3501af12-4a78-4900-b523-a3cbafcf9f44" returned: 0 in 0.286s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:18 devstack cinder-volume[87128]: WARNING cinder.quota [None req-dcffcbef-3dff-4da0-8a8e-14d5535eb0f3 tempest-GroupSnapshotsV319Test-30724332 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1881984811 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1881984811, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:06:18 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9b1f8dc6-72c5-4696-b6fa-2bab9567a528 tempest-VolumeQuotasAdminTestJSON-110095171 None] Lock "cinder-quobyte-3501af12-4a78-4900-b523-a3cbafcf9f44" released by "delete_volume" :: held 0.828s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:18 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-dcffcbef-3dff-4da0-8a8e-14d5535eb0f3 tempest-GroupSnapshotsV319Test-30724332 None] Created reservations ['f1d97cca-ff5c-4f5a-aa01-25ad4cec0184', 'eefc9ce7-400b-4b1a-9527-092201a303f3', '6171a8aa-0a3a-45bc-9472-0d1ee5f23f34', 'd3c998fe-23ab-4963-b004-a20b8393642b'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:18 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-9b1f8dc6-72c5-4696-b6fa-2bab9567a528 tempest-VolumeQuotasAdminTestJSON-110095171 None] Created reservations ['b0be86cc-e7a5-46c0-832c-d130d902fee7', 'bd18f6cf-987d-4197-89fa-5d52ec6e3372', 'ddf3f13d-9a74-4066-b3a0-f1c86bb49786', '7f9cc836-f684-42d3-b520-6c8ab8f9c7d0'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9b1f8dc6-72c5-4696-b6fa-2bab9567a528 tempest-VolumeQuotasAdminTestJSON-110095171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9b1f8dc6-72c5-4696-b6fa-2bab9567a528 tempest-VolumeQuotasAdminTestJSON-110095171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-9b1f8dc6-72c5-4696-b6fa-2bab9567a528 tempest-VolumeQuotasAdminTestJSON-110095171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-9b1f8dc6-72c5-4696-b6fa-2bab9567a528 tempest-VolumeQuotasAdminTestJSON-110095171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9b1f8dc6-72c5-4696-b6fa-2bab9567a528 tempest-VolumeQuotasAdminTestJSON-110095171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9b1f8dc6-72c5-4696-b6fa-2bab9567a528 tempest-VolumeQuotasAdminTestJSON-110095171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-dcffcbef-3dff-4da0-8a8e-14d5535eb0f3 tempest-GroupSnapshotsV319Test-30724332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-dcffcbef-3dff-4da0-8a8e-14d5535eb0f3 tempest-GroupSnapshotsV319Test-30724332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-dcffcbef-3dff-4da0-8a8e-14d5535eb0f3 tempest-GroupSnapshotsV319Test-30724332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-dcffcbef-3dff-4da0-8a8e-14d5535eb0f3 tempest-GroupSnapshotsV319Test-30724332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-dcffcbef-3dff-4da0-8a8e-14d5535eb0f3 tempest-GroupSnapshotsV319Test-30724332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-dcffcbef-3dff-4da0-8a8e-14d5535eb0f3 tempest-GroupSnapshotsV319Test-30724332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:18 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:06:18 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:18 devstack sudo[97685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:06:18 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:19 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:19 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-dcffcbef-3dff-4da0-8a8e-14d5535eb0f3 tempest-GroupSnapshotsV319Test-30724332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.298s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:19 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-dcffcbef-3dff-4da0-8a8e-14d5535eb0f3 tempest-GroupSnapshotsV319Test-30724332 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9b1f8dc6-72c5-4696-b6fa-2bab9567a528 tempest-VolumeQuotasAdminTestJSON-110095171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.326s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:19 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-9b1f8dc6-72c5-4696-b6fa-2bab9567a528 tempest-VolumeQuotasAdminTestJSON-110095171 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:19 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-dcffcbef-3dff-4da0-8a8e-14d5535eb0f3 tempest-GroupSnapshotsV319Test-30724332 None] Delete group completed successfully. Sep 01 02:06:19 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-9b1f8dc6-72c5-4696-b6fa-2bab9567a528 tempest-VolumeQuotasAdminTestJSON-110095171 None] Deleted volume successfully. Sep 01 02:06:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9b1f8dc6-72c5-4696-b6fa-2bab9567a528 tempest-VolumeQuotasAdminTestJSON-110095171 None] Lock "cinder-3501af12-4a78-4900-b523-a3cbafcf9f44-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:20 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_oc1f5ulydevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1c53b0b6-043a-4275-afc5-6d0e749e4977" returned: 0 in 2.558s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:20 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_oc1f5ulydevstack@QuobyteHD, size 112.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1c53b0b6-043a-4275-afc5-6d0e749e4977 {{(pid=87128) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:06:20 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Converted 112.00 MB image at 43.75 MB/s Sep 01 02:06:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1c53b0b6-043a-4275-afc5-6d0e749e4977 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:20 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1c53b0b6-043a-4275-afc5-6d0e749e4977 1G Sep 01 02:06:20 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:21 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1c53b0b6-043a-4275-afc5-6d0e749e4977 1G" returned: 0 in 0.416s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:21 devstack cinder-volume[87128]: DEBUG cinder.volume.volume_utils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Downloaded image 64fc298b-4656-41e6-a52e-bd149cb491e9 ((None, [{'url': 'file:///opt/stack/data/glance/images/64fc298b-4656-41e6-a52e-bd149cb491e9', 'metadata': {}}])) to volume 1c53b0b6-043a-4275-afc5-6d0e749e4977 successfully. {{(pid=87128) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:06:21 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Temporary image 64fc298b-4656-41e6-a52e-bd149cb491e9 for user 59b983b2f7a4408ead6f119763eafeb7 is deleted. {{(pid=87128) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:06:21 devstack cinder-volume[87128]: DEBUG cinder.volume.volume_utils [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Marking volume 1c53b0b6-043a-4275-afc5-6d0e749e4977 as bootable. {{(pid=87128) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:06:21 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Copying metadata from image 64fc298b-4656-41e6-a52e-bd149cb491e9 to 1c53b0b6-043a-4275-afc5-6d0e749e4977. {{(pid=87128) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:06:21 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Creating volume glance metadata for volume 1c53b0b6-043a-4275-afc5-6d0e749e4977 backed by image 64fc298b-4656-41e6-a52e-bd149cb491e9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87128) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:06:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4c65a61-3755-433c-a1e5-ffc1a274afd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c53b0b6-043a-4275-afc5-6d0e749e4977', 'volume_size': 1, 'image_id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64fc298b-4656-41e6-a52e-bd149cb491e9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0dbd8f0a33a74d5db3271102e89b70d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'created_at': datetime.datetime(2026, 8, 31, 23, 51, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 51, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64fc298b-4656-41e6-a52e-bd149cb491e9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1035cc27-b768-4470-8e4b-8960221a374e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:21 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Volume volume-1c53b0b6-043a-4275-afc5-6d0e749e4977 (1c53b0b6-043a-4275-afc5-6d0e749e4977): created successfully Sep 01 02:06:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1035cc27-b768-4470-8e4b-8960221a374e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Flow 'volume_create_manager' (287948e8-5d10-419a-b8a3-8e243f54f81f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:21 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-2da3b292-0731-4937-b6f7-965057b4b761 tempest-TestShelveInstance-1570247602 None] Created volume successfully. Sep 01 02:06:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-0f57e034-ca3a-4db3-b2a0-1aeb48ff219f req-b17ad258-3d24-4db4-96ab-c644a39483de tempest-TestShelveInstance-1570247602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-0f57e034-ca3a-4db3-b2a0-1aeb48ff219f req-b17ad258-3d24-4db4-96ab-c644a39483de tempest-TestShelveInstance-1570247602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-0f57e034-ca3a-4db3-b2a0-1aeb48ff219f req-b17ad258-3d24-4db4-96ab-c644a39483de tempest-TestShelveInstance-1570247602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-0f57e034-ca3a-4db3-b2a0-1aeb48ff219f req-b17ad258-3d24-4db4-96ab-c644a39483de tempest-TestShelveInstance-1570247602 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb', 'name': 'volume-1c53b0b6-043a-4275-afc5-6d0e749e4977', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '777d6ca0-5d22-4def-8cce-fb8df287703e', 'enforce_multipath': True} {{(pid=87128) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:06:26 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-0f57e034-ca3a-4db3-b2a0-1aeb48ff219f req-b17ad258-3d24-4db4-96ab-c644a39483de tempest-TestShelveInstance-1570247602 None] attachment_update completed successfully. Sep 01 02:06:27 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-dc6ceffa-0f2c-4fe5-967c-26e4cd2f016a tempest-GroupsTest-1180477858 None] Group tempest-Group1-672864284: creating Sep 01 02:06:27 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-dc6ceffa-0f2c-4fe5-967c-26e4cd2f016a tempest-GroupsTest-1180477858 None] Group tempest-Group1-672864284: created successfully Sep 01 02:06:27 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-dc6ceffa-0f2c-4fe5-967c-26e4cd2f016a tempest-GroupsTest-1180477858 None] Create group completed successfully. Sep 01 02:06:28 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-1df21e5a-934b-450c-8c33-2352f7a0121f tempest-GroupsTest-1180477858 None] Group tempest-Group2-741977305: creating Sep 01 02:06:28 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-1df21e5a-934b-450c-8c33-2352f7a0121f tempest-GroupsTest-1180477858 None] Group tempest-Group2-741977305: created successfully Sep 01 02:06:28 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-1df21e5a-934b-450c-8c33-2352f7a0121f tempest-GroupsTest-1180477858 None] Create group completed successfully. Sep 01 02:06:29 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Flow 'volume_create_manager' (8b26d94d-9799-41a3-a036-98d4288851de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17aeb87e-1cfc-4c12-9097-44f2e3314027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17aeb87e-1cfc-4c12-9097-44f2e3314027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1789918127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e278af3f-fac0-47c8-8d57-a928dd31161b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e39707f45df426d8e38aaf25cc0b73b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:29Z,use_quota=True,user_id='68606e7f878a49d7ae0fd8f5e1c16b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdbe07f6-0756-4856-bf72-69172cca9c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdbe07f6-0756-4856-bf72-69172cca9c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95bd04fa-c6b1-4ede-a70a-e1db030268a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95bd04fa-c6b1-4ede-a70a-e1db030268a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e278af3f-fac0-47c8-8d57-a928dd31161b', 'volume_name': 'volume-e278af3f-fac0-47c8-8d57-a928dd31161b', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de5f360e-6c7f-49ad-9010-a2722e3ccaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de5f360e-6c7f-49ad-9010-a2722e3ccaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75b93671-c7cb-4104-b41f-cd7fee0f6617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:29 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Volume e278af3f-fac0-47c8-8d57-a928dd31161b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e278af3f-fac0-47c8-8d57-a928dd31161b', 'volume_size': 1} Sep 01 02:06:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:29 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1789918127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e278af3f-fac0-47c8-8d57-a928dd31161b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e39707f45df426d8e38aaf25cc0b73b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:29Z,use_quota=True,user_id='68606e7f878a49d7ae0fd8f5e1c16b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:29 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Creating volume e278af3f-fac0-47c8-8d57-a928dd31161b {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:29 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:29 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:29 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:29 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:06:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e278af3f-fac0-47c8-8d57-a928dd31161b 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:29 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e278af3f-fac0-47c8-8d57-a928dd31161b 1073741824 Sep 01 02:06:29 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:30 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e278af3f-fac0-47c8-8d57-a928dd31161b 1073741824" returned: 0 in 0.996s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e278af3f-fac0-47c8-8d57-a928dd31161b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:30 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e278af3f-fac0-47c8-8d57-a928dd31161b Sep 01 02:06:30 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:30 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] Flow 'volume_create_manager' (eb99d9a3-cad8-467d-8bdf-9300b0a40d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6104a75-a110-493d-bb2c-23d49fde95fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6104a75-a110-493d-bb2c-23d49fde95fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-930148847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=46eea34c-d416-4c88-aa01-3d65009f7fe6,host='devstack@QuobyteHD#QuobyteHD',id=1d2795ff-dba6-427a-8714-293f9bf2b428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb355c11fb1e4195b2488c55496a7efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:31Z,use_quota=True,user_id='dbe6978cd41c4941865872d981853615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c14262c-5975-4261-89f0-cbc49efc0e97),volume_type_id=1c14262c-5975-4261-89f0-cbc49efc0e97)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d65b33-71fe-4601-b9e1-d3437aedbb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d65b33-71fe-4601-b9e1-d3437aedbb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3900bc0d-6bbf-4ec2-a942-db73542ad270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3900bc0d-6bbf-4ec2-a942-db73542ad270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d2795ff-dba6-427a-8714-293f9bf2b428', 'volume_name': 'volume-1d2795ff-dba6-427a-8714-293f9bf2b428', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad77427-d62f-4fd9-9a93-53983083183d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad77427-d62f-4fd9-9a93-53983083183d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2512804c-12fc-42cb-8b54-3e02d239bcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:30 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] Volume 1d2795ff-dba6-427a-8714-293f9bf2b428: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d2795ff-dba6-427a-8714-293f9bf2b428', 'volume_size': 1} Sep 01 02:06:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:31 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e278af3f-fac0-47c8-8d57-a928dd31161b" returned: 0 in 0.448s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:31 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.072s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:31 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=46eea34c-d416-4c88-aa01-3d65009f7fe6,created_at=2026-09-01T00:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-930148847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=46eea34c-d416-4c88-aa01-3d65009f7fe6,host='devstack@QuobyteHD#QuobyteHD',id=1d2795ff-dba6-427a-8714-293f9bf2b428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb355c11fb1e4195b2488c55496a7efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:31Z,use_quota=True,user_id='dbe6978cd41c4941865872d981853615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c14262c-5975-4261-89f0-cbc49efc0e97),volume_type_id=1c14262c-5975-4261-89f0-cbc49efc0e97)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:31 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] Creating volume 1d2795ff-dba6-427a-8714-293f9bf2b428 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:31 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:31 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:31 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:31 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:06:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1d2795ff-dba6-427a-8714-293f9bf2b428 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75b93671-c7cb-4104-b41f-cd7fee0f6617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e278af3f-fac0-47c8-8d57-a928dd31161b', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e9fef6f-96e3-4b7d-901a-ee3f52d5012c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:31 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1d2795ff-dba6-427a-8714-293f9bf2b428 1073741824 Sep 01 02:06:31 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:31 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Volume volume-e278af3f-fac0-47c8-8d57-a928dd31161b (e278af3f-fac0-47c8-8d57-a928dd31161b): created successfully Sep 01 02:06:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e9fef6f-96e3-4b7d-901a-ee3f52d5012c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Flow 'volume_create_manager' (8b26d94d-9799-41a3-a036-98d4288851de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:31 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-d10b0bdc-d696-45b8-a1d8-dddaaf80f73a tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Created volume successfully. Sep 01 02:06:31 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1d2795ff-dba6-427a-8714-293f9bf2b428 1073741824" returned: 0 in 0.664s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1d2795ff-dba6-427a-8714-293f9bf2b428 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:31 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1d2795ff-dba6-427a-8714-293f9bf2b428 Sep 01 02:06:31 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:32 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1d2795ff-dba6-427a-8714-293f9bf2b428" returned: 0 in 0.417s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:32 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2512804c-12fc-42cb-8b54-3e02d239bcc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d2795ff-dba6-427a-8714-293f9bf2b428', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37839317-68ce-4f9b-95bb-3aad26cc5d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:32 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] Volume volume-1d2795ff-dba6-427a-8714-293f9bf2b428 (1d2795ff-dba6-427a-8714-293f9bf2b428): created successfully Sep 01 02:06:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37839317-68ce-4f9b-95bb-3aad26cc5d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] Flow 'volume_create_manager' (eb99d9a3-cad8-467d-8bdf-9300b0a40d2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:32 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-28114968-cb54-4485-b5b2-989e2d3c1208 tempest-GroupsTest-1180477858 None] Created volume successfully. Sep 01 02:06:32 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-af4bfcb5-317a-429b-97ad-4e039d8a94ce tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Acquiring lock "cinder-e278af3f-fac0-47c8-8d57-a928dd31161b-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:32 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-af4bfcb5-317a-429b-97ad-4e039d8a94ce tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Lock "cinder-e278af3f-fac0-47c8-8d57-a928dd31161b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:32 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-af4bfcb5-317a-429b-97ad-4e039d8a94ce tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Acquiring lock "cinder-quobyte-e278af3f-fac0-47c8-8d57-a928dd31161b" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:32 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-af4bfcb5-317a-429b-97ad-4e039d8a94ce tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Lock "cinder-quobyte-e278af3f-fac0-47c8-8d57-a928dd31161b" acquired by "delete_volume" :: waited 0.019s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:32 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[87960035-71ae-4b1a-8ab4-ebe0311315ee]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af4bfcb5-317a-429b-97ad-4e039d8a94ce tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e278af3f-fac0-47c8-8d57-a928dd31161b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:32 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e278af3f-fac0-47c8-8d57-a928dd31161b Sep 01 02:06:32 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:33 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af4bfcb5-317a-429b-97ad-4e039d8a94ce tempest-VolumeQuotasNegativeTestJSON-1930343801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e278af3f-fac0-47c8-8d57-a928dd31161b" returned: 0 in 0.405s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af4bfcb5-317a-429b-97ad-4e039d8a94ce tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e278af3f-fac0-47c8-8d57-a928dd31161b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:33 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e278af3f-fac0-47c8-8d57-a928dd31161b Sep 01 02:06:33 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:33 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af4bfcb5-317a-429b-97ad-4e039d8a94ce tempest-VolumeQuotasNegativeTestJSON-1930343801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e278af3f-fac0-47c8-8d57-a928dd31161b" returned: 0 in 0.381s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:33 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-af4bfcb5-317a-429b-97ad-4e039d8a94ce tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Lock "cinder-quobyte-e278af3f-fac0-47c8-8d57-a928dd31161b" released by "delete_volume" :: held 0.831s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:33 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-af4bfcb5-317a-429b-97ad-4e039d8a94ce tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Created reservations ['e8646fbf-fecb-404c-97b7-54643dfcc455', 'c3419ac1-3bf4-4c82-9425-17d90024a541', 'e88a628b-cf69-4f13-afda-c8d971cf04bd', '58462442-c812-44de-afdd-a1a60a49dca8'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-af4bfcb5-317a-429b-97ad-4e039d8a94ce tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-af4bfcb5-317a-429b-97ad-4e039d8a94ce tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-af4bfcb5-317a-429b-97ad-4e039d8a94ce tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-af4bfcb5-317a-429b-97ad-4e039d8a94ce tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-af4bfcb5-317a-429b-97ad-4e039d8a94ce tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af4bfcb5-317a-429b-97ad-4e039d8a94ce tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:33 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:06:33 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:34 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af4bfcb5-317a-429b-97ad-4e039d8a94ce tempest-VolumeQuotasNegativeTestJSON-1930343801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.408s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:34 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-af4bfcb5-317a-429b-97ad-4e039d8a94ce tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:34 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-af4bfcb5-317a-429b-97ad-4e039d8a94ce tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Deleted volume successfully. Sep 01 02:06:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-af4bfcb5-317a-429b-97ad-4e039d8a94ce tempest-VolumeQuotasNegativeTestJSON-1930343801 None] Lock "cinder-e278af3f-fac0-47c8-8d57-a928dd31161b-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4aa13997-d928-45f8-81f8-37948a3bf0eb tempest-GroupsTest-1180477858 None] Acquiring lock "cinder-quobyte-1d2795ff-dba6-427a-8714-293f9bf2b428" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4aa13997-d928-45f8-81f8-37948a3bf0eb tempest-GroupsTest-1180477858 None] Lock "cinder-quobyte-1d2795ff-dba6-427a-8714-293f9bf2b428" acquired by "delete_volume" :: waited 0.025s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:34 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[356ba7f5-1698-4648-be82-cef5ddfaf842]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4aa13997-d928-45f8-81f8-37948a3bf0eb tempest-GroupsTest-1180477858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1d2795ff-dba6-427a-8714-293f9bf2b428 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:34 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1d2795ff-dba6-427a-8714-293f9bf2b428 Sep 01 02:06:34 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:35 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4aa13997-d928-45f8-81f8-37948a3bf0eb tempest-GroupsTest-1180477858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1d2795ff-dba6-427a-8714-293f9bf2b428" returned: 0 in 0.661s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4aa13997-d928-45f8-81f8-37948a3bf0eb tempest-GroupsTest-1180477858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1d2795ff-dba6-427a-8714-293f9bf2b428 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:35 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1d2795ff-dba6-427a-8714-293f9bf2b428 Sep 01 02:06:35 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:35 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4aa13997-d928-45f8-81f8-37948a3bf0eb tempest-GroupsTest-1180477858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1d2795ff-dba6-427a-8714-293f9bf2b428" returned: 0 in 0.456s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4aa13997-d928-45f8-81f8-37948a3bf0eb tempest-GroupsTest-1180477858 None] Lock "cinder-quobyte-1d2795ff-dba6-427a-8714-293f9bf2b428" released by "delete_volume" :: held 1.193s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:36 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-4aa13997-d928-45f8-81f8-37948a3bf0eb tempest-GroupsTest-1180477858 None] Created reservations ['729ca1c8-0a2e-4e9d-95f5-1ca923cda5c2'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:36 devstack cinder-volume[87128]: WARNING cinder.quota [None req-4aa13997-d928-45f8-81f8-37948a3bf0eb tempest-GroupsTest-1180477858 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1183485355 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1183485355, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:06:36 devstack cinder-volume[87128]: WARNING cinder.quota [None req-4aa13997-d928-45f8-81f8-37948a3bf0eb tempest-GroupsTest-1180477858 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1183485355 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1183485355, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:06:36 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-4aa13997-d928-45f8-81f8-37948a3bf0eb tempest-GroupsTest-1180477858 None] Created reservations ['117ff448-968a-486b-8bb9-b01821843650', '9300810b-20c7-4d28-a590-1a69f8ab1109', '46f5b93e-7d12-4369-b0d1-e92b16752bad', '5bca29cd-baf2-4e59-ac43-ea8c78664130'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4aa13997-d928-45f8-81f8-37948a3bf0eb tempest-GroupsTest-1180477858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4aa13997-d928-45f8-81f8-37948a3bf0eb tempest-GroupsTest-1180477858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:36 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4aa13997-d928-45f8-81f8-37948a3bf0eb tempest-GroupsTest-1180477858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:36 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4aa13997-d928-45f8-81f8-37948a3bf0eb tempest-GroupsTest-1180477858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4aa13997-d928-45f8-81f8-37948a3bf0eb tempest-GroupsTest-1180477858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4aa13997-d928-45f8-81f8-37948a3bf0eb tempest-GroupsTest-1180477858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:36 devstack sudo[97909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:06:36 devstack sudo[97909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:37 devstack sudo[97909]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4aa13997-d928-45f8-81f8-37948a3bf0eb tempest-GroupsTest-1180477858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.540s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:37 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-4aa13997-d928-45f8-81f8-37948a3bf0eb tempest-GroupsTest-1180477858 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:37 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-4aa13997-d928-45f8-81f8-37948a3bf0eb tempest-GroupsTest-1180477858 None] Delete group completed successfully. Sep 01 02:06:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-7ae77747-827a-46a7-a676-eed0915ecfba req-2bd8daf4-5b27-4a5e-b403-d0ea58278aee tempest-TestInstancesWithCinderVolumes-1326876574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-7ae77747-827a-46a7-a676-eed0915ecfba req-2bd8daf4-5b27-4a5e-b403-d0ea58278aee tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-7ae77747-827a-46a7-a676-eed0915ecfba req-2bd8daf4-5b27-4a5e-b403-d0ea58278aee tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-7ae77747-827a-46a7-a676-eed0915ecfba req-2bd8daf4-5b27-4a5e-b403-d0ea58278aee tempest-TestInstancesWithCinderVolumes-1326876574 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb', 'name': 'volume-612eba68-bcab-4bf6-a828-c2ea50d95589', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '86fe6e44-a34d-43ef-a708-fecabedfaeb8', 'enforce_multipath': True} {{(pid=87128) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:06:37 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-7ae77747-827a-46a7-a676-eed0915ecfba req-2bd8daf4-5b27-4a5e-b403-d0ea58278aee tempest-TestInstancesWithCinderVolumes-1326876574 None] attachment_update completed successfully. Sep 01 02:06:37 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-d2accfe0-1407-4572-9509-60868dffd6bc tempest-GroupsTest-1180477858 None] Created reservations ['d80d5b03-f0e9-4b26-a77d-3ed81e062617'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d2accfe0-1407-4572-9509-60868dffd6bc tempest-GroupsTest-1180477858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d2accfe0-1407-4572-9509-60868dffd6bc tempest-GroupsTest-1180477858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:37 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d2accfe0-1407-4572-9509-60868dffd6bc tempest-GroupsTest-1180477858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:37 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d2accfe0-1407-4572-9509-60868dffd6bc tempest-GroupsTest-1180477858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d2accfe0-1407-4572-9509-60868dffd6bc tempest-GroupsTest-1180477858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d2accfe0-1407-4572-9509-60868dffd6bc tempest-GroupsTest-1180477858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:37 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:06:37 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:38 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d2accfe0-1407-4572-9509-60868dffd6bc tempest-GroupsTest-1180477858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.451s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:38 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-d2accfe0-1407-4572-9509-60868dffd6bc tempest-GroupsTest-1180477858 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:38 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-d2accfe0-1407-4572-9509-60868dffd6bc tempest-GroupsTest-1180477858 None] Delete group completed successfully. Sep 01 02:06:39 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-c3a254b5-a883-414f-b168-6ee2112c64bb tempest-GroupsTest-1180477858 None] Group tempest-GroupsTest-Group-1608590741: creating Sep 01 02:06:39 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-c3a254b5-a883-414f-b168-6ee2112c64bb tempest-GroupsTest-1180477858 None] Group tempest-GroupsTest-Group-1608590741: created successfully Sep 01 02:06:39 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-c3a254b5-a883-414f-b168-6ee2112c64bb tempest-GroupsTest-1180477858 None] Create group completed successfully. Sep 01 02:06:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-5c5bef58-3703-4936-b919-e900901d6ee4 req-08450aa4-f218-43d3-b58b-7cfdf93055b9 tempest-TestInstancesWithCinderVolumes-1326876574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-5c5bef58-3703-4936-b919-e900901d6ee4 req-08450aa4-f218-43d3-b58b-7cfdf93055b9 tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-5c5bef58-3703-4936-b919-e900901d6ee4 req-08450aa4-f218-43d3-b58b-7cfdf93055b9 tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:40 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-5c5bef58-3703-4936-b919-e900901d6ee4 req-08450aa4-f218-43d3-b58b-7cfdf93055b9 tempest-TestInstancesWithCinderVolumes-1326876574 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb', 'name': 'volume-7d69fdbe-18c4-4e1d-8c82-eea20f6835c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7df39cbc-4ef4-46c3-b0e6-f1ca48c73845', 'enforce_multipath': True} {{(pid=87128) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:06:40 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-5c5bef58-3703-4936-b919-e900901d6ee4 req-08450aa4-f218-43d3-b58b-7cfdf93055b9 tempest-TestInstancesWithCinderVolumes-1326876574 None] attachment_update completed successfully. Sep 01 02:06:41 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] Flow 'volume_create_manager' (3fe8dfe4-9c56-4346-a30a-b56a71e74d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (588d5d80-e1c9-4eb0-b0c8-a8f51f5bd3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (588d5d80-e1c9-4eb0-b0c8-a8f51f5bd3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-796776383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9b7700d2-314e-4505-9a0a-a42c28dcedb0,host='devstack@QuobyteHD#QuobyteHD',id=6d94b12b-b24a-4085-9324-bc9e32ddf63b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb355c11fb1e4195b2488c55496a7efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:41Z,use_quota=True,user_id='dbe6978cd41c4941865872d981853615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f4849f0-a9e8-48e6-b7ed-eb0bcabfae44),volume_type_id=9f4849f0-a9e8-48e6-b7ed-eb0bcabfae44)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aedc4d6d-f35d-48c6-a6ab-32b3ce1a4553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aedc4d6d-f35d-48c6-a6ab-32b3ce1a4553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d23e2d-dd02-4e0d-9ae6-83ffd4b3daaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d23e2d-dd02-4e0d-9ae6-83ffd4b3daaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d94b12b-b24a-4085-9324-bc9e32ddf63b', 'volume_name': 'volume-6d94b12b-b24a-4085-9324-bc9e32ddf63b', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddfcc02d-e78b-4b47-bcc3-a8bd45704ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddfcc02d-e78b-4b47-bcc3-a8bd45704ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8fc8e6c-e57a-4921-8b64-c60bb61509ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:41 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] Volume 6d94b12b-b24a-4085-9324-bc9e32ddf63b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d94b12b-b24a-4085-9324-bc9e32ddf63b', 'volume_size': 1} Sep 01 02:06:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9b7700d2-314e-4505-9a0a-a42c28dcedb0,created_at=2026-09-01T00:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-796776383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9b7700d2-314e-4505-9a0a-a42c28dcedb0,host='devstack@QuobyteHD#QuobyteHD',id=6d94b12b-b24a-4085-9324-bc9e32ddf63b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb355c11fb1e4195b2488c55496a7efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:41Z,use_quota=True,user_id='dbe6978cd41c4941865872d981853615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f4849f0-a9e8-48e6-b7ed-eb0bcabfae44),volume_type_id=9f4849f0-a9e8-48e6-b7ed-eb0bcabfae44)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] Creating volume 6d94b12b-b24a-4085-9324-bc9e32ddf63b {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:41 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:06:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6d94b12b-b24a-4085-9324-bc9e32ddf63b 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:41 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6d94b12b-b24a-4085-9324-bc9e32ddf63b 1073741824 Sep 01 02:06:41 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:41 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6d94b12b-b24a-4085-9324-bc9e32ddf63b 1073741824" returned: 0 in 0.476s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6d94b12b-b24a-4085-9324-bc9e32ddf63b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:41 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6d94b12b-b24a-4085-9324-bc9e32ddf63b Sep 01 02:06:41 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:42 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6d94b12b-b24a-4085-9324-bc9e32ddf63b" returned: 0 in 0.278s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8fc8e6c-e57a-4921-8b64-c60bb61509ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d94b12b-b24a-4085-9324-bc9e32ddf63b', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea8d0dd6-7941-4921-91e5-2ae11dd4557b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:42 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] Volume volume-6d94b12b-b24a-4085-9324-bc9e32ddf63b (6d94b12b-b24a-4085-9324-bc9e32ddf63b): created successfully Sep 01 02:06:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea8d0dd6-7941-4921-91e5-2ae11dd4557b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] Flow 'volume_create_manager' (3fe8dfe4-9c56-4346-a30a-b56a71e74d85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:42 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-5dada7fa-3296-4ce6-a924-b2aa07c15509 tempest-GroupsTest-1180477858 None] Created volume successfully. Sep 01 02:06:42 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] Flow 'volume_create_manager' (d314ccf0-7b87-4b63-9ecf-ff807b50488e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47576382-e20d-4c72-9c86-113df4ca3ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47576382-e20d-4c72-9c86-113df4ca3ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1950920531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab06153a-c373-4966-a84e-e831732f525b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e928fe74bc4f45088ad8cd950887df8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:43Z,use_quota=True,user_id='8ba389e7484f4590bfd7bf144b9040d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ab5aec-bfb0-4b49-a027-d2615ad8a160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ab5aec-bfb0-4b49-a027-d2615ad8a160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (019daadd-bb5f-4e33-b784-7f9d8a8dc8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (019daadd-bb5f-4e33-b784-7f9d8a8dc8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab06153a-c373-4966-a84e-e831732f525b', 'volume_name': 'volume-ab06153a-c373-4966-a84e-e831732f525b', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bdd85a5-92ee-4289-a10c-b7ac3b868780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bdd85a5-92ee-4289-a10c-b7ac3b868780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33df9ecc-e67b-418f-bbf4-79c3b14ddfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:42 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] Volume ab06153a-c373-4966-a84e-e831732f525b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab06153a-c373-4966-a84e-e831732f525b', 'volume_size': 1} Sep 01 02:06:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1950920531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab06153a-c373-4966-a84e-e831732f525b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e928fe74bc4f45088ad8cd950887df8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:43Z,use_quota=True,user_id='8ba389e7484f4590bfd7bf144b9040d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] Creating volume ab06153a-c373-4966-a84e-e831732f525b {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:42 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:06:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ab06153a-c373-4966-a84e-e831732f525b 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:42 devstack sudo[97958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ab06153a-c373-4966-a84e-e831732f525b 1073741824 Sep 01 02:06:42 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:43 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ab06153a-c373-4966-a84e-e831732f525b 1073741824" returned: 0 in 0.479s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ab06153a-c373-4966-a84e-e831732f525b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:43 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ab06153a-c373-4966-a84e-e831732f525b Sep 01 02:06:43 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:43 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ab06153a-c373-4966-a84e-e831732f525b" returned: 0 in 0.298s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:43 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33df9ecc-e67b-418f-bbf4-79c3b14ddfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab06153a-c373-4966-a84e-e831732f525b', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d23653a-7246-49db-83c6-0bd2fcef61bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:43 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] Volume volume-ab06153a-c373-4966-a84e-e831732f525b (ab06153a-c373-4966-a84e-e831732f525b): created successfully Sep 01 02:06:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d23653a-7246-49db-83c6-0bd2fcef61bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] Flow 'volume_create_manager' (d314ccf0-7b87-4b63-9ecf-ff807b50488e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:43 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-c68d2625-5e43-4114-9d97-accf80a9e5f2 tempest-VolumesServicesTestJSON-1613874534 None] Created volume successfully. Sep 01 02:06:44 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] Flow 'volume_create_manager' (b36b744a-7262-4fc6-b298-a0b7a6fb956f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d74afce-01f1-4716-9479-2c967aa8186c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d74afce-01f1-4716-9479-2c967aa8186c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1499655846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9b7700d2-314e-4505-9a0a-a42c28dcedb0,host='devstack@QuobyteHD#QuobyteHD',id=9c9e792f-7146-4d06-ba04-c3cf4abdd26d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb355c11fb1e4195b2488c55496a7efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:44Z,use_quota=True,user_id='dbe6978cd41c4941865872d981853615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f4849f0-a9e8-48e6-b7ed-eb0bcabfae44),volume_type_id=9f4849f0-a9e8-48e6-b7ed-eb0bcabfae44)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20e1495b-3f2c-464e-8e02-5ec20578daf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20e1495b-3f2c-464e-8e02-5ec20578daf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2040bcc-363b-4c74-92e4-aeca426b509a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2040bcc-363b-4c74-92e4-aeca426b509a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c9e792f-7146-4d06-ba04-c3cf4abdd26d', 'volume_name': 'volume-9c9e792f-7146-4d06-ba04-c3cf4abdd26d', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e7b898-a77a-4e87-a0f0-73a2d9d8f261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e7b898-a77a-4e87-a0f0-73a2d9d8f261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (688d4df8-7c65-4fd9-b798-e863fab94981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:44 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] Volume 9c9e792f-7146-4d06-ba04-c3cf4abdd26d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c9e792f-7146-4d06-ba04-c3cf4abdd26d', 'volume_size': 1} Sep 01 02:06:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:44 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9b7700d2-314e-4505-9a0a-a42c28dcedb0,created_at=2026-09-01T00:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1499655846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9b7700d2-314e-4505-9a0a-a42c28dcedb0,host='devstack@QuobyteHD#QuobyteHD',id=9c9e792f-7146-4d06-ba04-c3cf4abdd26d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb355c11fb1e4195b2488c55496a7efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:44Z,use_quota=True,user_id='dbe6978cd41c4941865872d981853615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f4849f0-a9e8-48e6-b7ed-eb0bcabfae44),volume_type_id=9f4849f0-a9e8-48e6-b7ed-eb0bcabfae44)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:44 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] Creating volume 9c9e792f-7146-4d06-ba04-c3cf4abdd26d {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:44 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:44 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:44 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:44 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:06:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9c9e792f-7146-4d06-ba04-c3cf4abdd26d 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:44 devstack sudo[97973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9c9e792f-7146-4d06-ba04-c3cf4abdd26d 1073741824 Sep 01 02:06:44 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:44 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9c9e792f-7146-4d06-ba04-c3cf4abdd26d 1073741824" returned: 0 in 0.538s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9c9e792f-7146-4d06-ba04-c3cf4abdd26d {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:44 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ebc9de66-bf80-434c-a1c4-1e35a2bb8bea tempest-VolumesServicesTestJSON-1613874534 None] Acquiring lock "cinder-ab06153a-c373-4966-a84e-e831732f525b-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:44 devstack sudo[97979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9c9e792f-7146-4d06-ba04-c3cf4abdd26d Sep 01 02:06:44 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:44 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ebc9de66-bf80-434c-a1c4-1e35a2bb8bea tempest-VolumesServicesTestJSON-1613874534 None] Lock "cinder-ab06153a-c373-4966-a84e-e831732f525b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:45 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ebc9de66-bf80-434c-a1c4-1e35a2bb8bea tempest-VolumesServicesTestJSON-1613874534 None] Acquiring lock "cinder-quobyte-ab06153a-c373-4966-a84e-e831732f525b" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:45 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ebc9de66-bf80-434c-a1c4-1e35a2bb8bea tempest-VolumesServicesTestJSON-1613874534 None] Lock "cinder-quobyte-ab06153a-c373-4966-a84e-e831732f525b" acquired by "delete_volume" :: waited 0.029s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:45 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d4b020-11f7-41a7-90bf-d0b3e47ee9b1]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ebc9de66-bf80-434c-a1c4-1e35a2bb8bea tempest-VolumesServicesTestJSON-1613874534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ab06153a-c373-4966-a84e-e831732f525b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:45 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9c9e792f-7146-4d06-ba04-c3cf4abdd26d" returned: 0 in 0.334s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:45 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:45 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ab06153a-c373-4966-a84e-e831732f525b Sep 01 02:06:45 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:45 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (688d4df8-7c65-4fd9-b798-e863fab94981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c9e792f-7146-4d06-ba04-c3cf4abdd26d', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:45 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a732274-9393-4cb2-ac1a-f29b8f56307e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:45 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] Volume volume-9c9e792f-7146-4d06-ba04-c3cf4abdd26d (9c9e792f-7146-4d06-ba04-c3cf4abdd26d): created successfully Sep 01 02:06:45 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a732274-9393-4cb2-ac1a-f29b8f56307e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:45 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] Flow 'volume_create_manager' (b36b744a-7262-4fc6-b298-a0b7a6fb956f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:45 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-b5ebd386-67f6-40c1-8743-6aa5b8588fc3 tempest-GroupsTest-1180477858 None] Created volume successfully. Sep 01 02:06:45 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ebc9de66-bf80-434c-a1c4-1e35a2bb8bea tempest-VolumesServicesTestJSON-1613874534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ab06153a-c373-4966-a84e-e831732f525b" returned: 0 in 0.448s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ebc9de66-bf80-434c-a1c4-1e35a2bb8bea tempest-VolumesServicesTestJSON-1613874534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ab06153a-c373-4966-a84e-e831732f525b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:45 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ab06153a-c373-4966-a84e-e831732f525b Sep 01 02:06:45 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:45 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-9e8342bb-9fe6-4d6b-b77e-3f2c6cc3260f tempest-GroupsTest-1180477858 None] Update group completed successfully. Sep 01 02:06:45 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ebc9de66-bf80-434c-a1c4-1e35a2bb8bea tempest-VolumesServicesTestJSON-1613874534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ab06153a-c373-4966-a84e-e831732f525b" returned: 0 in 0.289s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:45 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ebc9de66-bf80-434c-a1c4-1e35a2bb8bea tempest-VolumesServicesTestJSON-1613874534 None] Lock "cinder-quobyte-ab06153a-c373-4966-a84e-e831732f525b" released by "delete_volume" :: held 0.798s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:45 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-ebc9de66-bf80-434c-a1c4-1e35a2bb8bea tempest-VolumesServicesTestJSON-1613874534 None] Created reservations ['295f87e9-2e0e-4483-9245-03a4d11a7360', 'e134d383-9d00-457e-88a7-8958466fd688', '48fd0cf1-7627-4f71-98d9-5ff8050bc726', 'e6b1d63e-f2b9-4441-80a5-68c65d8a91c5'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ebc9de66-bf80-434c-a1c4-1e35a2bb8bea tempest-VolumesServicesTestJSON-1613874534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ebc9de66-bf80-434c-a1c4-1e35a2bb8bea tempest-VolumesServicesTestJSON-1613874534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:45 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-ebc9de66-bf80-434c-a1c4-1e35a2bb8bea tempest-VolumesServicesTestJSON-1613874534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:45 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-ebc9de66-bf80-434c-a1c4-1e35a2bb8bea tempest-VolumesServicesTestJSON-1613874534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ebc9de66-bf80-434c-a1c4-1e35a2bb8bea tempest-VolumesServicesTestJSON-1613874534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ebc9de66-bf80-434c-a1c4-1e35a2bb8bea tempest-VolumesServicesTestJSON-1613874534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:46 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:06:46 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:46 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ebc9de66-bf80-434c-a1c4-1e35a2bb8bea tempest-VolumesServicesTestJSON-1613874534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.255s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:46 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-ebc9de66-bf80-434c-a1c4-1e35a2bb8bea tempest-VolumesServicesTestJSON-1613874534 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:46 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-ebc9de66-bf80-434c-a1c4-1e35a2bb8bea tempest-VolumesServicesTestJSON-1613874534 None] Deleted volume successfully. Sep 01 02:06:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ebc9de66-bf80-434c-a1c4-1e35a2bb8bea tempest-VolumesServicesTestJSON-1613874534 None] Lock "cinder-ab06153a-c373-4966-a84e-e831732f525b-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:47 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-b4676cf0-dadc-4582-ac14-c8b7f3adcb12 tempest-GroupsTest-1180477858 None] Update group completed successfully. Sep 01 02:06:47 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-d5012da1-4d9e-4cbb-988d-e9a7181f900d req-9d5fbf9d-e329-4974-8f0f-811e97926f68 tempest-TestInstancesWithCinderVolumes-1326876574 None] Terminate volume connection completed successfully. Sep 01 02:06:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-d5012da1-4d9e-4cbb-988d-e9a7181f900d req-9d5fbf9d-e329-4974-8f0f-811e97926f68 tempest-TestInstancesWithCinderVolumes-1326876574 None] Deleting attachment 86fe6e44-a34d-43ef-a708-fecabedfaeb8. {{(pid=87128) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:06:48 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0285369c-5856-410f-9944-a406299209be tempest-TestInstancesWithCinderVolumes-1326876574 None] Acquiring lock "cinder-612eba68-bcab-4bf6-a828-c2ea50d95589-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:48 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0285369c-5856-410f-9944-a406299209be tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "cinder-612eba68-bcab-4bf6-a828-c2ea50d95589-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:48 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0285369c-5856-410f-9944-a406299209be tempest-TestInstancesWithCinderVolumes-1326876574 None] Acquiring lock "cinder-quobyte-612eba68-bcab-4bf6-a828-c2ea50d95589" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:48 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0285369c-5856-410f-9944-a406299209be tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "cinder-quobyte-612eba68-bcab-4bf6-a828-c2ea50d95589" acquired by "delete_volume" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:48 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3754bf9-e368-41d7-9c7c-b5b651b6ce6e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0285369c-5856-410f-9944-a406299209be tempest-TestInstancesWithCinderVolumes-1326876574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-612eba68-bcab-4bf6-a828-c2ea50d95589 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:48 devstack sudo[98022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-612eba68-bcab-4bf6-a828-c2ea50d95589 Sep 01 02:06:48 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:48 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0285369c-5856-410f-9944-a406299209be tempest-TestInstancesWithCinderVolumes-1326876574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-612eba68-bcab-4bf6-a828-c2ea50d95589" returned: 0 in 0.546s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0285369c-5856-410f-9944-a406299209be tempest-TestInstancesWithCinderVolumes-1326876574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-612eba68-bcab-4bf6-a828-c2ea50d95589 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:48 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-612eba68-bcab-4bf6-a828-c2ea50d95589 Sep 01 02:06:48 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fcd09a92-0950-403f-befc-f703002c5a0a tempest-GroupsTest-1180477858 None] Acquiring lock "cinder-quobyte-6d94b12b-b24a-4085-9324-bc9e32ddf63b" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fcd09a92-0950-403f-befc-f703002c5a0a tempest-GroupsTest-1180477858 None] Lock "cinder-quobyte-6d94b12b-b24a-4085-9324-bc9e32ddf63b" acquired by "delete_volume" :: waited 0.036s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:49 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0285369c-5856-410f-9944-a406299209be tempest-TestInstancesWithCinderVolumes-1326876574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-612eba68-bcab-4bf6-a828-c2ea50d95589" returned: 0 in 0.381s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0285369c-5856-410f-9944-a406299209be tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "cinder-quobyte-612eba68-bcab-4bf6-a828-c2ea50d95589" released by "delete_volume" :: held 0.995s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:49 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[838addab-25c8-41a3-8a27-18d1eb26ec47]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fcd09a92-0950-403f-befc-f703002c5a0a tempest-GroupsTest-1180477858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6d94b12b-b24a-4085-9324-bc9e32ddf63b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:49 devstack cinder-volume[87128]: WARNING cinder.quota [None req-0285369c-5856-410f-9944-a406299209be tempest-TestInstancesWithCinderVolumes-1326876574 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1298016780-1943749230 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1298016780-1943749230, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:06:49 devstack cinder-volume[87128]: WARNING cinder.quota [None req-0285369c-5856-410f-9944-a406299209be tempest-TestInstancesWithCinderVolumes-1326876574 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1298016780-1943749230 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1298016780-1943749230, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:06:49 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-0285369c-5856-410f-9944-a406299209be tempest-TestInstancesWithCinderVolumes-1326876574 None] Created reservations ['cf45d7e9-79ec-4f78-a61c-8f2dcdc064c0', 'b2172523-89a7-4ac2-bf2a-959669016b97', '37122773-73ba-4321-92d1-5bd859fde0cb', 'bceed6dd-32e7-498f-b0de-1863e656d7d7'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:49 devstack sudo[98030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6d94b12b-b24a-4085-9324-bc9e32ddf63b Sep 01 02:06:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0285369c-5856-410f-9944-a406299209be tempest-TestInstancesWithCinderVolumes-1326876574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0285369c-5856-410f-9944-a406299209be tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0285369c-5856-410f-9944-a406299209be tempest-TestInstancesWithCinderVolumes-1326876574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:49 devstack sudo[98030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0285369c-5856-410f-9944-a406299209be tempest-TestInstancesWithCinderVolumes-1326876574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0285369c-5856-410f-9944-a406299209be tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0285369c-5856-410f-9944-a406299209be tempest-TestInstancesWithCinderVolumes-1326876574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:49 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:06:49 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:49 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0285369c-5856-410f-9944-a406299209be tempest-TestInstancesWithCinderVolumes-1326876574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.313s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:49 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-0285369c-5856-410f-9944-a406299209be tempest-TestInstancesWithCinderVolumes-1326876574 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:49 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-0285369c-5856-410f-9944-a406299209be tempest-TestInstancesWithCinderVolumes-1326876574 None] Deleted volume successfully. Sep 01 02:06:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0285369c-5856-410f-9944-a406299209be tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "cinder-612eba68-bcab-4bf6-a828-c2ea50d95589-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:49 devstack sudo[98030]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fcd09a92-0950-403f-befc-f703002c5a0a tempest-GroupsTest-1180477858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6d94b12b-b24a-4085-9324-bc9e32ddf63b" returned: 0 in 0.623s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fcd09a92-0950-403f-befc-f703002c5a0a tempest-GroupsTest-1180477858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6d94b12b-b24a-4085-9324-bc9e32ddf63b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:49 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6d94b12b-b24a-4085-9324-bc9e32ddf63b Sep 01 02:06:49 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:50 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fcd09a92-0950-403f-befc-f703002c5a0a tempest-GroupsTest-1180477858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6d94b12b-b24a-4085-9324-bc9e32ddf63b" returned: 0 in 0.276s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fcd09a92-0950-403f-befc-f703002c5a0a tempest-GroupsTest-1180477858 None] Lock "cinder-quobyte-6d94b12b-b24a-4085-9324-bc9e32ddf63b" released by "delete_volume" :: held 0.977s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fcd09a92-0950-403f-befc-f703002c5a0a tempest-GroupsTest-1180477858 None] Acquiring lock "cinder-quobyte-9c9e792f-7146-4d06-ba04-c3cf4abdd26d" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fcd09a92-0950-403f-befc-f703002c5a0a tempest-GroupsTest-1180477858 None] Lock "cinder-quobyte-9c9e792f-7146-4d06-ba04-c3cf4abdd26d" acquired by "delete_volume" :: waited 0.020s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:50 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23d2dc4-056e-499f-88d3-25320bee1a75]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fcd09a92-0950-403f-befc-f703002c5a0a tempest-GroupsTest-1180477858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9c9e792f-7146-4d06-ba04-c3cf4abdd26d {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:50 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9c9e792f-7146-4d06-ba04-c3cf4abdd26d Sep 01 02:06:50 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:50 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fcd09a92-0950-403f-befc-f703002c5a0a tempest-GroupsTest-1180477858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9c9e792f-7146-4d06-ba04-c3cf4abdd26d" returned: 0 in 0.407s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fcd09a92-0950-403f-befc-f703002c5a0a tempest-GroupsTest-1180477858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9c9e792f-7146-4d06-ba04-c3cf4abdd26d {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:50 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9c9e792f-7146-4d06-ba04-c3cf4abdd26d Sep 01 02:06:50 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:50 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fcd09a92-0950-403f-befc-f703002c5a0a tempest-GroupsTest-1180477858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9c9e792f-7146-4d06-ba04-c3cf4abdd26d" returned: 0 in 0.275s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fcd09a92-0950-403f-befc-f703002c5a0a tempest-GroupsTest-1180477858 None] Lock "cinder-quobyte-9c9e792f-7146-4d06-ba04-c3cf4abdd26d" released by "delete_volume" :: held 0.735s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:51 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-fcd09a92-0950-403f-befc-f703002c5a0a tempest-GroupsTest-1180477858 None] Created reservations ['b8fcfedc-a312-4af1-b679-93a72e69a331'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:51 devstack cinder-volume[87128]: WARNING cinder.quota [None req-fcd09a92-0950-403f-befc-f703002c5a0a tempest-GroupsTest-1180477858 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2068577416 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2068577416, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:06:51 devstack cinder-volume[87128]: WARNING cinder.quota [None req-fcd09a92-0950-403f-befc-f703002c5a0a tempest-GroupsTest-1180477858 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2068577416 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2068577416, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:06:51 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-fcd09a92-0950-403f-befc-f703002c5a0a tempest-GroupsTest-1180477858 None] Created reservations ['67c73ed5-4136-4571-b43d-75170e1c1a85', '69da7b93-6378-49ab-ab41-f4976ed91124', 'dee38459-6fd0-49fb-8005-7f5ebce9ba9d', 'b9f34396-ba46-4fd4-8f46-fe439c1837e7'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:51 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-fcd09a92-0950-403f-befc-f703002c5a0a tempest-GroupsTest-1180477858 None] Created reservations ['aca66174-3eea-4567-9605-4e9549cc5bc5', '044a8abf-d45e-42bd-898c-4714ed8f4ce9', 'a4b2231a-d3f1-4648-8c30-74ecc9dca185', '03c9dc8f-8041-4e55-b08c-9b3a23d7c626'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fcd09a92-0950-403f-befc-f703002c5a0a tempest-GroupsTest-1180477858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fcd09a92-0950-403f-befc-f703002c5a0a tempest-GroupsTest-1180477858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:51 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fcd09a92-0950-403f-befc-f703002c5a0a tempest-GroupsTest-1180477858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:51 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fcd09a92-0950-403f-befc-f703002c5a0a tempest-GroupsTest-1180477858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fcd09a92-0950-403f-befc-f703002c5a0a tempest-GroupsTest-1180477858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fcd09a92-0950-403f-befc-f703002c5a0a tempest-GroupsTest-1180477858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:51 devstack sudo[98060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:06:51 devstack sudo[98060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:51 devstack sudo[98060]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fcd09a92-0950-403f-befc-f703002c5a0a tempest-GroupsTest-1180477858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.269s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:51 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-fcd09a92-0950-403f-befc-f703002c5a0a tempest-GroupsTest-1180477858 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:51 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-fcd09a92-0950-403f-befc-f703002c5a0a tempest-GroupsTest-1180477858 None] Delete group completed successfully. Sep 01 02:06:52 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-d2c6fdb4-8cce-4189-a3f0-ca94d6da12b1 req-d46fb497-02ab-4f8e-83bd-354f49bf7a1a tempest-TestInstancesWithCinderVolumes-1326876574 None] Terminate volume connection completed successfully. Sep 01 02:06:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-d2c6fdb4-8cce-4189-a3f0-ca94d6da12b1 req-d46fb497-02ab-4f8e-83bd-354f49bf7a1a tempest-TestInstancesWithCinderVolumes-1326876574 None] Deleting attachment 7df39cbc-4ef4-46c3-b0e6-f1ca48c73845. {{(pid=87128) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:06:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-a0a33402-fb0f-4996-81d9-b04442b505c5 tempest-TestInstancesWithCinderVolumes-1326876574 None] Acquiring lock "cinder-7d69fdbe-18c4-4e1d-8c82-eea20f6835c8-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-a0a33402-fb0f-4996-81d9-b04442b505c5 tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "cinder-7d69fdbe-18c4-4e1d-8c82-eea20f6835c8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-a0a33402-fb0f-4996-81d9-b04442b505c5 tempest-TestInstancesWithCinderVolumes-1326876574 None] Acquiring lock "cinder-quobyte-7d69fdbe-18c4-4e1d-8c82-eea20f6835c8" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-a0a33402-fb0f-4996-81d9-b04442b505c5 tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "cinder-quobyte-7d69fdbe-18c4-4e1d-8c82-eea20f6835c8" acquired by "delete_volume" :: waited 0.019s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:53 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f452e0-5549-4dd6-8bbc-2735f3d3c5d5]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a0a33402-fb0f-4996-81d9-b04442b505c5 tempest-TestInstancesWithCinderVolumes-1326876574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7d69fdbe-18c4-4e1d-8c82-eea20f6835c8 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:53 devstack sudo[98076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7d69fdbe-18c4-4e1d-8c82-eea20f6835c8 Sep 01 02:06:53 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:54 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a0a33402-fb0f-4996-81d9-b04442b505c5 tempest-TestInstancesWithCinderVolumes-1326876574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7d69fdbe-18c4-4e1d-8c82-eea20f6835c8" returned: 0 in 0.466s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a0a33402-fb0f-4996-81d9-b04442b505c5 tempest-TestInstancesWithCinderVolumes-1326876574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7d69fdbe-18c4-4e1d-8c82-eea20f6835c8 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:54 devstack sudo[98081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7d69fdbe-18c4-4e1d-8c82-eea20f6835c8 Sep 01 02:06:54 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:54 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a0a33402-fb0f-4996-81d9-b04442b505c5 tempest-TestInstancesWithCinderVolumes-1326876574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7d69fdbe-18c4-4e1d-8c82-eea20f6835c8" returned: 0 in 0.335s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:54 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-a0a33402-fb0f-4996-81d9-b04442b505c5 tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "cinder-quobyte-7d69fdbe-18c4-4e1d-8c82-eea20f6835c8" released by "delete_volume" :: held 0.880s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:54 devstack cinder-volume[87128]: WARNING cinder.quota [None req-a0a33402-fb0f-4996-81d9-b04442b505c5 tempest-TestInstancesWithCinderVolumes-1326876574 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-726250350-1721387366 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-726250350-1721387366, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:06:54 devstack cinder-volume[87128]: WARNING cinder.quota [None req-a0a33402-fb0f-4996-81d9-b04442b505c5 tempest-TestInstancesWithCinderVolumes-1326876574 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-726250350-1721387366 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-726250350-1721387366, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:06:54 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-a0a33402-fb0f-4996-81d9-b04442b505c5 tempest-TestInstancesWithCinderVolumes-1326876574 None] Created reservations ['9f9c2a59-5511-4da4-a9e3-1185b4557d6b', '9fefd541-f08d-42fa-a30a-4a5d04e62df3', 'd69cb374-1f24-4e5c-aeb3-ebe9804d2576', '9c0b63a8-ad82-4ef3-8117-98341a3a763c'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a0a33402-fb0f-4996-81d9-b04442b505c5 tempest-TestInstancesWithCinderVolumes-1326876574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a0a33402-fb0f-4996-81d9-b04442b505c5 tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a0a33402-fb0f-4996-81d9-b04442b505c5 tempest-TestInstancesWithCinderVolumes-1326876574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a0a33402-fb0f-4996-81d9-b04442b505c5 tempest-TestInstancesWithCinderVolumes-1326876574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a0a33402-fb0f-4996-81d9-b04442b505c5 tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a0a33402-fb0f-4996-81d9-b04442b505c5 tempest-TestInstancesWithCinderVolumes-1326876574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:54 devstack sudo[98084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:06:54 devstack sudo[98084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:55 devstack sudo[98084]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a0a33402-fb0f-4996-81d9-b04442b505c5 tempest-TestInstancesWithCinderVolumes-1326876574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.303s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:55 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-a0a33402-fb0f-4996-81d9-b04442b505c5 tempest-TestInstancesWithCinderVolumes-1326876574 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:55 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-a0a33402-fb0f-4996-81d9-b04442b505c5 tempest-TestInstancesWithCinderVolumes-1326876574 None] Deleted volume successfully. Sep 01 02:06:55 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-a0a33402-fb0f-4996-81d9-b04442b505c5 tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "cinder-7d69fdbe-18c4-4e1d-8c82-eea20f6835c8-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:59 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-7a9557a1-833b-482f-b524-f161cdb53660 req-8c4f7d3c-7d05-470e-9762-b83a43f3ee39 tempest-TestInstancesWithCinderVolumes-1326876574 None] Terminate volume connection completed successfully. Sep 01 02:06:59 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-7a9557a1-833b-482f-b524-f161cdb53660 req-8c4f7d3c-7d05-470e-9762-b83a43f3ee39 tempest-TestInstancesWithCinderVolumes-1326876574 None] Deleting attachment a68c281f-7a75-48ef-ab12-ddcf438704ef. {{(pid=87128) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:06:59 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-22503246-941e-41dd-9b81-ff5b2204495a tempest-GroupsV314Test-1615047458 None] Group tempest-GroupsV314Test-Group-1440961449: creating Sep 01 02:06:59 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-22503246-941e-41dd-9b81-ff5b2204495a tempest-GroupsV314Test-1615047458 None] Group tempest-GroupsV314Test-Group-1440961449: created successfully Sep 01 02:06:59 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-22503246-941e-41dd-9b81-ff5b2204495a tempest-GroupsV314Test-1615047458 None] Create group completed successfully. Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] Flow 'volume_create_manager' (b5b69be9-eedf-4721-a403-727eb07cfd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (277cfae6-e097-4896-adc9-cd61946c3b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1c7e1d36-d39a-41c5-826e-d7832efb01bd tempest-TestInstancesWithCinderVolumes-1326876574 None] Acquiring lock "cinder-4bd14f2c-8ae2-4d73-b309-858fe0df8c84-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (277cfae6-e097-4896-adc9-cd61946c3b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1993443756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=937d1987-e31d-47a3-8b29-f96949b87513,host='devstack@QuobyteHD#QuobyteHD',id=a2083f9a-b9cc-450f-ad81-f4455ecaa67a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fc6c28de1d04e2fa90f0e48100d8804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:01Z,use_quota=True,user_id='372ff9e441e94c9fb17e3313d58201c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c82c678-9f0e-468d-88e6-9fb2535ae9d0),volume_type_id=6c82c678-9f0e-468d-88e6-9fb2535ae9d0)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05305156-0852-406a-96ca-aa9acbbbaaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05305156-0852-406a-96ca-aa9acbbbaaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81633f78-e21a-488b-878c-d2085d1d9580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81633f78-e21a-488b-878c-d2085d1d9580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2083f9a-b9cc-450f-ad81-f4455ecaa67a', 'volume_name': 'volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae4bf41-c964-4f99-8fb1-e698cd368fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae4bf41-c964-4f99-8fb1-e698cd368fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35fdf38b-159b-477f-a862-bfe3827c793f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:01 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] Volume a2083f9a-b9cc-450f-ad81-f4455ecaa67a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a', 'volume_size': 1} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=937d1987-e31d-47a3-8b29-f96949b87513,created_at=2026-09-01T00:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1993443756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=937d1987-e31d-47a3-8b29-f96949b87513,host='devstack@QuobyteHD#QuobyteHD',id=a2083f9a-b9cc-450f-ad81-f4455ecaa67a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fc6c28de1d04e2fa90f0e48100d8804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:01Z,use_quota=True,user_id='372ff9e441e94c9fb17e3313d58201c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c82c678-9f0e-468d-88e6-9fb2535ae9d0),volume_type_id=6c82c678-9f0e-468d-88e6-9fb2535ae9d0)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] Creating volume a2083f9a-b9cc-450f-ad81-f4455ecaa67a {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:07:01 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1c7e1d36-d39a-41c5-826e-d7832efb01bd tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "cinder-4bd14f2c-8ae2-4d73-b309-858fe0df8c84-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:01 devstack sudo[98116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a 1073741824 Sep 01 02:07:01 devstack sudo[98116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1c7e1d36-d39a-41c5-826e-d7832efb01bd tempest-TestInstancesWithCinderVolumes-1326876574 None] Acquiring lock "cinder-quobyte-4bd14f2c-8ae2-4d73-b309-858fe0df8c84" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1c7e1d36-d39a-41c5-826e-d7832efb01bd tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "cinder-quobyte-4bd14f2c-8ae2-4d73-b309-858fe0df8c84" acquired by "delete_volume" :: waited 0.037s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] Flow 'volume_create_manager' (299d15f7-d636-4c21-97a6-a4529752ad20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9980e1d-22df-42be-9a3e-e1c18aef202d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea71fd74-eb1f-4915-9f85-d6d06b0c5c09]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1c7e1d36-d39a-41c5-826e-d7832efb01bd tempest-TestInstancesWithCinderVolumes-1326876574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4bd14f2c-8ae2-4d73-b309-858fe0df8c84 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9980e1d-22df-42be-9a3e-e1c18aef202d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1706957276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c22142-6b2e-497f-a940-8917ac7d253a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='998cedd712ee43ceb6740ae0373b0b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:01Z,use_quota=True,user_id='40574419771b4d8fbfac6718f0b8bb0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9021b118-238b-4bb4-8fab-df868f7a2cb3),volume_type_id=9021b118-238b-4bb4-8fab-df868f7a2cb3)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d2de31-76b5-46fa-8ece-2cb7b9161f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d2de31-76b5-46fa-8ece-2cb7b9161f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (795daa32-c0b6-4ca1-a202-5d241858b7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (795daa32-c0b6-4ca1-a202-5d241858b7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71c22142-6b2e-497f-a940-8917ac7d253a', 'volume_name': 'volume-71c22142-6b2e-497f-a940-8917ac7d253a', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e5efd64-2672-4c0d-b9c5-342fe36e6cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e5efd64-2672-4c0d-b9c5-342fe36e6cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10cf7c6-8d5f-44a3-9ac6-485a92932683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:01 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] Volume 71c22142-6b2e-497f-a940-8917ac7d253a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71c22142-6b2e-497f-a940-8917ac7d253a', 'volume_size': 1} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:01 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4bd14f2c-8ae2-4d73-b309-858fe0df8c84 Sep 01 02:07:01 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:01 devstack sudo[98116]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a 1073741824" returned: 0 in 0.458s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:01 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a Sep 01 02:07:01 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:01 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1c7e1d36-d39a-41c5-826e-d7832efb01bd tempest-TestInstancesWithCinderVolumes-1326876574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4bd14f2c-8ae2-4d73-b309-858fe0df8c84" returned: 0 in 0.373s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1c7e1d36-d39a-41c5-826e-d7832efb01bd tempest-TestInstancesWithCinderVolumes-1326876574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4bd14f2c-8ae2-4d73-b309-858fe0df8c84 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:01 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4bd14f2c-8ae2-4d73-b309-858fe0df8c84 Sep 01 02:07:01 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:02 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a" returned: 0 in 0.252s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.525s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1706957276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c22142-6b2e-497f-a940-8917ac7d253a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='998cedd712ee43ceb6740ae0373b0b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:01Z,use_quota=True,user_id='40574419771b4d8fbfac6718f0b8bb0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9021b118-238b-4bb4-8fab-df868f7a2cb3),volume_type_id=9021b118-238b-4bb4-8fab-df868f7a2cb3)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] Creating volume 71c22142-6b2e-497f-a940-8917ac7d253a {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:07:02 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-71c22142-6b2e-497f-a940-8917ac7d253a 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35fdf38b-159b-477f-a862-bfe3827c793f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d5c86d-35bf-48a7-869f-116e8a24ee21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:02 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-71c22142-6b2e-497f-a940-8917ac7d253a 1073741824 Sep 01 02:07:02 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:02 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1c7e1d36-d39a-41c5-826e-d7832efb01bd tempest-TestInstancesWithCinderVolumes-1326876574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4bd14f2c-8ae2-4d73-b309-858fe0df8c84" returned: 0 in 0.255s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1c7e1d36-d39a-41c5-826e-d7832efb01bd tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "cinder-quobyte-4bd14f2c-8ae2-4d73-b309-858fe0df8c84" released by "delete_volume" :: held 0.691s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:02 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] Volume volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a (a2083f9a-b9cc-450f-ad81-f4455ecaa67a): created successfully Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d5c86d-35bf-48a7-869f-116e8a24ee21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] Flow 'volume_create_manager' (b5b69be9-eedf-4721-a403-727eb07cfd3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:02 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-fc6c978f-8ec2-4603-b161-17048305fd5b tempest-GroupsV314Test-1615047458 None] Created volume successfully. Sep 01 02:07:02 devstack cinder-volume[87128]: WARNING cinder.quota [None req-1c7e1d36-d39a-41c5-826e-d7832efb01bd tempest-TestInstancesWithCinderVolumes-1326876574 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1626414447-1804054 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1626414447-1804054, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:07:02 devstack cinder-volume[87128]: WARNING cinder.quota [None req-1c7e1d36-d39a-41c5-826e-d7832efb01bd tempest-TestInstancesWithCinderVolumes-1326876574 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1626414447-1804054 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1626414447-1804054, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-1c7e1d36-d39a-41c5-826e-d7832efb01bd tempest-TestInstancesWithCinderVolumes-1326876574 None] Created reservations ['d8eb1796-ffd6-4d2c-a2ab-85309f040dab', '62916f1a-c3fb-4e59-a70d-180260bafda9', 'e014e5a1-fb3f-45aa-850a-a655247cdfd6', '14e9f948-ea7c-4a02-b8bb-fd70fdd515fd'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1c7e1d36-d39a-41c5-826e-d7832efb01bd tempest-TestInstancesWithCinderVolumes-1326876574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1c7e1d36-d39a-41c5-826e-d7832efb01bd tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1c7e1d36-d39a-41c5-826e-d7832efb01bd tempest-TestInstancesWithCinderVolumes-1326876574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1c7e1d36-d39a-41c5-826e-d7832efb01bd tempest-TestInstancesWithCinderVolumes-1326876574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1c7e1d36-d39a-41c5-826e-d7832efb01bd tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1c7e1d36-d39a-41c5-826e-d7832efb01bd tempest-TestInstancesWithCinderVolumes-1326876574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:02 devstack sudo[98135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:07:02 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:02 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1c7e1d36-d39a-41c5-826e-d7832efb01bd tempest-TestInstancesWithCinderVolumes-1326876574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.354s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-1c7e1d36-d39a-41c5-826e-d7832efb01bd tempest-TestInstancesWithCinderVolumes-1326876574 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:02 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:02 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-1c7e1d36-d39a-41c5-826e-d7832efb01bd tempest-TestInstancesWithCinderVolumes-1326876574 None] Deleted volume successfully. Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=158,cinder:UPDATE=156,cinder:INSERT=42,cinder:DELETE=5 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-71c22142-6b2e-497f-a940-8917ac7d253a 1073741824" returned: 0 in 0.575s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:UPDATE=145,cinder:SELECT=135,cinder:DELETE=12,cinder:INSERT=34 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1c7e1d36-d39a-41c5-826e-d7832efb01bd tempest-TestInstancesWithCinderVolumes-1326876574 None] Lock "cinder-4bd14f2c-8ae2-4d73-b309-858fe0df8c84-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-71c22142-6b2e-497f-a940-8917ac7d253a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:02 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-71c22142-6b2e-497f-a940-8917ac7d253a Sep 01 02:07:02 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:02 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-71c22142-6b2e-497f-a940-8917ac7d253a" returned: 0 in 0.291s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10cf7c6-8d5f-44a3-9ac6-485a92932683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71c22142-6b2e-497f-a940-8917ac7d253a', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cea011ba-f8b9-4ae0-bd82-846537a55407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:03 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] Volume volume-71c22142-6b2e-497f-a940-8917ac7d253a (71c22142-6b2e-497f-a940-8917ac7d253a): created successfully Sep 01 02:07:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cea011ba-f8b9-4ae0-bd82-846537a55407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] Flow 'volume_create_manager' (299d15f7-d636-4c21-97a6-a4529752ad20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:03 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-a8b63bd9-e5e9-4667-98de-ed1252c26674 tempest-VolumeTypesAccessTest-1450250685 None] Created volume successfully. Sep 01 02:07:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:03 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Cloning volume a2083f9a-b9cc-450f-ad81-f4455ecaa67a to volume 9dedd767-e660-47f6-8c56-b9b8c30994dd Sep 01 02:07:03 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Creating offline snapshot 2d1860ed-c05d-464f-9852-b50442d2f732 of volume a2083f9a-b9cc-450f-ad81-f4455ecaa67a {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:07:03 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8bfb30-2ce3-41d3-8734-35f1b39daefb]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:03 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a Sep 01 02:07:03 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:03 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a" returned: 0 in 0.433s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a.2d1860ed-c05d-464f-9852-b50442d2f732 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:03 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b0b736cc-24df-4093-bfae-2b49af57e514 tempest-VolumeTypesAccessTest-1450250685 None] Acquiring lock "cinder-71c22142-6b2e-497f-a940-8917ac7d253a-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:03 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a.2d1860ed-c05d-464f-9852-b50442d2f732 1G Sep 01 02:07:03 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:03 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b0b736cc-24df-4093-bfae-2b49af57e514 tempest-VolumeTypesAccessTest-1450250685 None] Lock "cinder-71c22142-6b2e-497f-a940-8917ac7d253a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:03 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b0b736cc-24df-4093-bfae-2b49af57e514 tempest-VolumeTypesAccessTest-1450250685 None] Acquiring lock "cinder-quobyte-71c22142-6b2e-497f-a940-8917ac7d253a" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:03 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b0b736cc-24df-4093-bfae-2b49af57e514 tempest-VolumeTypesAccessTest-1450250685 None] Lock "cinder-quobyte-71c22142-6b2e-497f-a940-8917ac7d253a" acquired by "delete_volume" :: waited 0.021s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:03 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3d12a5-64fc-48be-aabd-9c79fc86c379]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b0b736cc-24df-4093-bfae-2b49af57e514 tempest-VolumeTypesAccessTest-1450250685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-71c22142-6b2e-497f-a940-8917ac7d253a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:03 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-71c22142-6b2e-497f-a940-8917ac7d253a Sep 01 02:07:03 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:04 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a.2d1860ed-c05d-464f-9852-b50442d2f732 1G" returned: 0 in 0.456s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a.2d1860ed-c05d-464f-9852-b50442d2f732 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:04 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a.2d1860ed-c05d-464f-9852-b50442d2f732 Sep 01 02:07:04 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:04 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b0b736cc-24df-4093-bfae-2b49af57e514 tempest-VolumeTypesAccessTest-1450250685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-71c22142-6b2e-497f-a940-8917ac7d253a" returned: 0 in 0.390s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b0b736cc-24df-4093-bfae-2b49af57e514 tempest-VolumeTypesAccessTest-1450250685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-71c22142-6b2e-497f-a940-8917ac7d253a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:04 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-71c22142-6b2e-497f-a940-8917ac7d253a Sep 01 02:07:04 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:04 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a.2d1860ed-c05d-464f-9852-b50442d2f732" returned: 0 in 0.340s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:04 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a.2d1860ed-c05d-464f-9852-b50442d2f732 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:07:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a.2d1860ed-c05d-464f-9852-b50442d2f732 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:04 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b0b736cc-24df-4093-bfae-2b49af57e514 tempest-VolumeTypesAccessTest-1450250685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-71c22142-6b2e-497f-a940-8917ac7d253a" returned: 0 in 0.279s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:04 devstack sudo[98168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a.2d1860ed-c05d-464f-9852-b50442d2f732 Sep 01 02:07:04 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:04 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b0b736cc-24df-4093-bfae-2b49af57e514 tempest-VolumeTypesAccessTest-1450250685 None] Lock "cinder-quobyte-71c22142-6b2e-497f-a940-8917ac7d253a" released by "delete_volume" :: held 0.717s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:04 devstack cinder-volume[87128]: WARNING cinder.quota [None req-b0b736cc-24df-4093-bfae-2b49af57e514 tempest-VolumeTypesAccessTest-1450250685 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1459397052 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1459397052, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:07:04 devstack cinder-volume[87128]: WARNING cinder.quota [None req-b0b736cc-24df-4093-bfae-2b49af57e514 tempest-VolumeTypesAccessTest-1450250685 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1459397052 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1459397052, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:07:04 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-b0b736cc-24df-4093-bfae-2b49af57e514 tempest-VolumeTypesAccessTest-1450250685 None] Created reservations ['707ea8ec-5daf-4f4e-acfb-d5311ef28af9', 'df2518df-a8e2-4228-b0f4-863936ef96fb', '0d74af72-a233-49a9-8269-6a8b81485bc1', '3af7f875-f1e5-415c-9ad8-bf646da99e6d'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b0b736cc-24df-4093-bfae-2b49af57e514 tempest-VolumeTypesAccessTest-1450250685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b0b736cc-24df-4093-bfae-2b49af57e514 tempest-VolumeTypesAccessTest-1450250685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:04 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b0b736cc-24df-4093-bfae-2b49af57e514 tempest-VolumeTypesAccessTest-1450250685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:04 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b0b736cc-24df-4093-bfae-2b49af57e514 tempest-VolumeTypesAccessTest-1450250685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b0b736cc-24df-4093-bfae-2b49af57e514 tempest-VolumeTypesAccessTest-1450250685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b0b736cc-24df-4093-bfae-2b49af57e514 tempest-VolumeTypesAccessTest-1450250685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:04 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:07:04 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:04 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a.2d1860ed-c05d-464f-9852-b50442d2f732" returned: 0 in 0.361s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:04 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a.info Sep 01 02:07:04 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:04 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b0b736cc-24df-4093-bfae-2b49af57e514 tempest-VolumeTypesAccessTest-1450250685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.320s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:04 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-b0b736cc-24df-4093-bfae-2b49af57e514 tempest-VolumeTypesAccessTest-1450250685 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:04 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-b0b736cc-24df-4093-bfae-2b49af57e514 tempest-VolumeTypesAccessTest-1450250685 None] Deleted volume successfully. Sep 01 02:07:05 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b0b736cc-24df-4093-bfae-2b49af57e514 tempest-VolumeTypesAccessTest-1450250685 None] Lock "cinder-71c22142-6b2e-497f-a940-8917ac7d253a-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:05 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a.info" returned: 0 in 0.349s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:05 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:07:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:05 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a.info Sep 01 02:07:05 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:05 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a.info" returned: 0 in 0.293s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:05 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Acquiring lock "cinder-quobyte-9dedd767-e660-47f6-8c56-b9b8c30994dd" by "_copy_volume_from_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:05 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Lock "cinder-quobyte-9dedd767-e660-47f6-8c56-b9b8c30994dd" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:05 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] snapshot: 2d1860ed-c05d-464f-9852-b50442d2f732, volume: 9dedd767-e660-47f6-8c56-b9b8c30994dd, {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:07:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:05 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:05 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:05 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e5e05b-4054-44c3-b95b-668dbd49cfe6]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a.2d1860ed-c05d-464f-9852-b50442d2f732 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:05 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a.2d1860ed-c05d-464f-9852-b50442d2f732 Sep 01 02:07:05 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:05 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a.2d1860ed-c05d-464f-9852-b50442d2f732" returned: 0 in 0.410s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:05 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:07:05 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[7044a036-a465-401c-8673-0c457368234f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:06 devstack sudo[98187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a Sep 01 02:07:06 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:06 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a" returned: 0 in 0.397s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:06 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:07:06 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Creating direct copy from snapshot {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:07:06 devstack cinder-volume[87128]: DEBUG cinder.utils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Path /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9dedd767-e660-47f6-8c56-b9b8c30994dd not found in is_blk_device check {{(pid=87128) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:07:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9dedd767-e660-47f6-8c56-b9b8c30994dd {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:06 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9dedd767-e660-47f6-8c56-b9b8c30994dd Sep 01 02:07:06 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:12 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9dedd767-e660-47f6-8c56-b9b8c30994dd" returned: 0 in 5.726s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:12 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9dedd767-e660-47f6-8c56-b9b8c30994dd {{(pid=87128) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:07:12 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Converted 1024.00 MB image at 178.74 MB/s Sep 01 02:07:12 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9dedd767-e660-47f6-8c56-b9b8c30994dd is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:07:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9dedd767-e660-47f6-8c56-b9b8c30994dd {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:12 devstack sudo[98213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9dedd767-e660-47f6-8c56-b9b8c30994dd Sep 01 02:07:12 devstack sudo[98213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:12 devstack sudo[98213]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9dedd767-e660-47f6-8c56-b9b8c30994dd" returned: 0 in 0.358s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:12 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Lock "cinder-quobyte-9dedd767-e660-47f6-8c56-b9b8c30994dd" released by "_copy_volume_from_snapshot" :: held 6.978s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:12 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Acquiring lock "cinder-quobyte-2d1860ed-c05d-464f-9852-b50442d2f732" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:12 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Lock "cinder-quobyte-2d1860ed-c05d-464f-9852-b50442d2f732" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:12 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Deleting offline snapshot 2d1860ed-c05d-464f-9852-b50442d2f732 of volume a2083f9a-b9cc-450f-ad81-f4455ecaa67a {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:07:12 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] snapshot_file for this snap is: volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a.2d1860ed-c05d-464f-9852-b50442d2f732 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:07:12 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f93582-201d-4b86-99d8-2fdf72e1a709]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a.2d1860ed-c05d-464f-9852-b50442d2f732 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:12 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a.2d1860ed-c05d-464f-9852-b50442d2f732 Sep 01 02:07:12 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:13 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a.2d1860ed-c05d-464f-9852-b50442d2f732" returned: 0 in 0.522s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:13 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:07:13 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[8421932c-a96d-41cf-a20c-da4325cc280c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:13 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a Sep 01 02:07:13 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:13 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a" returned: 0 in 0.688s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a.2d1860ed-c05d-464f-9852-b50442d2f732 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:13 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a.2d1860ed-c05d-464f-9852-b50442d2f732 Sep 01 02:07:13 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:14 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a.2d1860ed-c05d-464f-9852-b50442d2f732" returned: 0 in 0.510s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a.2d1860ed-c05d-464f-9852-b50442d2f732 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:14 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a.2d1860ed-c05d-464f-9852-b50442d2f732 Sep 01 02:07:14 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:14 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a.2d1860ed-c05d-464f-9852-b50442d2f732" returned: 0 in 0.327s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:14 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Lock "cinder-quobyte-2d1860ed-c05d-464f-9852-b50442d2f732" released by "_delete_snapshot" :: held 2.267s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:14 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:UPDATE=12,cinder:SELECT=13,cinder:INSERT=5 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:07:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.745s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:15 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-a69ca8b2-8f8a-4e4f-a4ef-d4579dffbc20 tempest-GroupsV314Test-1615047458 None] Create group from source-group-937d1987-e31d-47a3-8b29-f96949b87513 completed successfully. Sep 01 02:07:15 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-ac928948-810d-4c41-8b35-f5ceabf2546f req-7d35eea6-8f6d-45c5-a173-a8c68f8636d7 tempest-TestShelveInstance-1570247602 None] Terminate volume connection completed successfully. Sep 01 02:07:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-ac928948-810d-4c41-8b35-f5ceabf2546f req-7d35eea6-8f6d-45c5-a173-a8c68f8636d7 tempest-TestShelveInstance-1570247602 None] Deleting attachment 777d6ca0-5d22-4def-8cce-fb8df287703e. {{(pid=87128) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:07:15 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f2235fea-53ea-46ef-9ed6-248b07212988 tempest-GroupsV314Test-1615047458 None] Acquiring lock "cinder-quobyte-9dedd767-e660-47f6-8c56-b9b8c30994dd" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:15 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f2235fea-53ea-46ef-9ed6-248b07212988 tempest-GroupsV314Test-1615047458 None] Lock "cinder-quobyte-9dedd767-e660-47f6-8c56-b9b8c30994dd" acquired by "delete_volume" :: waited 0.023s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:15 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4951fba-1e57-4932-a612-3eba6036aa56]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f2235fea-53ea-46ef-9ed6-248b07212988 tempest-GroupsV314Test-1615047458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9dedd767-e660-47f6-8c56-b9b8c30994dd {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:15 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9dedd767-e660-47f6-8c56-b9b8c30994dd Sep 01 02:07:15 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:16 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f2235fea-53ea-46ef-9ed6-248b07212988 tempest-GroupsV314Test-1615047458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9dedd767-e660-47f6-8c56-b9b8c30994dd" returned: 0 in 0.464s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f2235fea-53ea-46ef-9ed6-248b07212988 tempest-GroupsV314Test-1615047458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9dedd767-e660-47f6-8c56-b9b8c30994dd {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:16 devstack sudo[98265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9dedd767-e660-47f6-8c56-b9b8c30994dd Sep 01 02:07:16 devstack sudo[98265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:16 devstack sudo[98265]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f2235fea-53ea-46ef-9ed6-248b07212988 tempest-GroupsV314Test-1615047458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9dedd767-e660-47f6-8c56-b9b8c30994dd" returned: 0 in 0.346s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:16 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f2235fea-53ea-46ef-9ed6-248b07212988 tempest-GroupsV314Test-1615047458 None] Lock "cinder-quobyte-9dedd767-e660-47f6-8c56-b9b8c30994dd" released by "delete_volume" :: held 0.863s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:16 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-f2235fea-53ea-46ef-9ed6-248b07212988 tempest-GroupsV314Test-1615047458 None] Created reservations ['9d93a580-5cba-4bef-819c-4c5542abc2ce'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:16 devstack cinder-volume[87128]: WARNING cinder.quota [None req-f2235fea-53ea-46ef-9ed6-248b07212988 tempest-GroupsV314Test-1615047458 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-304844678 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-304844678, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:07:16 devstack cinder-volume[87128]: WARNING cinder.quota [None req-f2235fea-53ea-46ef-9ed6-248b07212988 tempest-GroupsV314Test-1615047458 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-304844678 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-304844678, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:07:16 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-f2235fea-53ea-46ef-9ed6-248b07212988 tempest-GroupsV314Test-1615047458 None] Created reservations ['9195a100-378c-4738-8f3f-d730d3ad9c37', '575a6101-9f04-430e-8882-c49f2ddcf176', 'f4199bb1-7b48-4635-b0f5-df7d0a77079e', '76b1d4ff-3ea7-48a6-840e-08c99310a1ac'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f2235fea-53ea-46ef-9ed6-248b07212988 tempest-GroupsV314Test-1615047458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f2235fea-53ea-46ef-9ed6-248b07212988 tempest-GroupsV314Test-1615047458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f2235fea-53ea-46ef-9ed6-248b07212988 tempest-GroupsV314Test-1615047458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f2235fea-53ea-46ef-9ed6-248b07212988 tempest-GroupsV314Test-1615047458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f2235fea-53ea-46ef-9ed6-248b07212988 tempest-GroupsV314Test-1615047458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f2235fea-53ea-46ef-9ed6-248b07212988 tempest-GroupsV314Test-1615047458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:16 devstack sudo[98268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:07:16 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:16 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:07:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:17 devstack sudo[98270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:07:17 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:17 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f2235fea-53ea-46ef-9ed6-248b07212988 tempest-GroupsV314Test-1615047458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.394s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:17 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-f2235fea-53ea-46ef-9ed6-248b07212988 tempest-GroupsV314Test-1615047458 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:17 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-f2235fea-53ea-46ef-9ed6-248b07212988 tempest-GroupsV314Test-1615047458 None] Delete group completed successfully. Sep 01 02:07:17 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-d71a70b7-514a-4e18-94ee-6da8473fbb1f tempest-GroupsV314Test-1615047458 None] Acquiring lock "cinder-quobyte-a2083f9a-b9cc-450f-ad81-f4455ecaa67a" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:17 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-d71a70b7-514a-4e18-94ee-6da8473fbb1f tempest-GroupsV314Test-1615047458 None] Lock "cinder-quobyte-a2083f9a-b9cc-450f-ad81-f4455ecaa67a" acquired by "delete_volume" :: waited 0.045s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:17 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.568s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:17 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:17 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager._thread_info {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:07:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread count: 29 {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:07:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread info: [<_MainThread(MainThread, started 128688016527488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:07:17 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e1f715-0f56-41fc-9c40-5083d2234cde]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d71a70b7-514a-4e18-94ee-6da8473fbb1f tempest-GroupsV314Test-1615047458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:17 devstack sudo[98275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a Sep 01 02:07:17 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:18 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d71a70b7-514a-4e18-94ee-6da8473fbb1f tempest-GroupsV314Test-1615047458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a" returned: 0 in 0.468s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d71a70b7-514a-4e18-94ee-6da8473fbb1f tempest-GroupsV314Test-1615047458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:18 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a Sep 01 02:07:18 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:18 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d71a70b7-514a-4e18-94ee-6da8473fbb1f tempest-GroupsV314Test-1615047458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a2083f9a-b9cc-450f-ad81-f4455ecaa67a" returned: 0 in 0.299s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:18 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-d71a70b7-514a-4e18-94ee-6da8473fbb1f tempest-GroupsV314Test-1615047458 None] Lock "cinder-quobyte-a2083f9a-b9cc-450f-ad81-f4455ecaa67a" released by "delete_volume" :: held 0.947s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:18 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-d71a70b7-514a-4e18-94ee-6da8473fbb1f tempest-GroupsV314Test-1615047458 None] Created reservations ['e3797327-ff1f-4cf4-961d-2e6af60288e3'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:18 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-d71a70b7-514a-4e18-94ee-6da8473fbb1f tempest-GroupsV314Test-1615047458 None] Created reservations ['6960a973-4824-4448-bbf4-0c5d439a489b', '2b142a1f-4dac-42c4-89fa-212f1587d153', '64813d6b-5ccb-45ac-9aa0-3f15e61a12fc', 'c3fe1a53-1d67-4e7f-9b14-f2db63bd4b94'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d71a70b7-514a-4e18-94ee-6da8473fbb1f tempest-GroupsV314Test-1615047458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d71a70b7-514a-4e18-94ee-6da8473fbb1f tempest-GroupsV314Test-1615047458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d71a70b7-514a-4e18-94ee-6da8473fbb1f tempest-GroupsV314Test-1615047458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d71a70b7-514a-4e18-94ee-6da8473fbb1f tempest-GroupsV314Test-1615047458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d71a70b7-514a-4e18-94ee-6da8473fbb1f tempest-GroupsV314Test-1615047458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d71a70b7-514a-4e18-94ee-6da8473fbb1f tempest-GroupsV314Test-1615047458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:18 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:07:18 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:19 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d71a70b7-514a-4e18-94ee-6da8473fbb1f tempest-GroupsV314Test-1615047458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.350s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:19 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-d71a70b7-514a-4e18-94ee-6da8473fbb1f tempest-GroupsV314Test-1615047458 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:19 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-d71a70b7-514a-4e18-94ee-6da8473fbb1f tempest-GroupsV314Test-1615047458 None] Delete group completed successfully. Sep 01 02:07:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-1d4efc46-bf45-4304-b3a0-9e6aacb8892c req-9d00fe20-7527-475b-aed4-34c37fe18528 tempest-TestShelveInstance-1570247602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-1d4efc46-bf45-4304-b3a0-9e6aacb8892c req-9d00fe20-7527-475b-aed4-34c37fe18528 tempest-TestShelveInstance-1570247602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-1d4efc46-bf45-4304-b3a0-9e6aacb8892c req-9d00fe20-7527-475b-aed4-34c37fe18528 tempest-TestShelveInstance-1570247602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-1d4efc46-bf45-4304-b3a0-9e6aacb8892c req-9d00fe20-7527-475b-aed4-34c37fe18528 tempest-TestShelveInstance-1570247602 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb', 'name': 'volume-1c53b0b6-043a-4275-afc5-6d0e749e4977', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b50d788-32cd-4fcc-be5a-302bb4c5bc43', 'enforce_multipath': True} {{(pid=87128) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:07:20 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-1d4efc46-bf45-4304-b3a0-9e6aacb8892c req-9d00fe20-7527-475b-aed4-34c37fe18528 tempest-TestShelveInstance-1570247602 None] attachment_update completed successfully. Sep 01 02:07:27 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] Flow 'volume_create_manager' (71bf5d60-9b15-4f5f-97aa-f4d379f5d479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b00c9a-aace-4cc8-aeda-aedd93b949ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b00c9a-aace-4cc8-aeda-aedd93b949ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1353584388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d6abe1d-58c4-4c3c-8a8b-38a142b6298c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6f3634d3844515a8d81b08fb7021c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:27Z,use_quota=True,user_id='c8809e5aebf1410c8c470dbab2925b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c0c15c2-0f21-4c17-a588-fe576c767fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c0c15c2-0f21-4c17-a588-fe576c767fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb886aa-e483-454d-ac33-36414f7b8550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb886aa-e483-454d-ac33-36414f7b8550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d6abe1d-58c4-4c3c-8a8b-38a142b6298c', 'volume_name': 'volume-8d6abe1d-58c4-4c3c-8a8b-38a142b6298c', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84f9361-c66a-4eb2-a2c4-c6af864021c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84f9361-c66a-4eb2-a2c4-c6af864021c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14428832-526b-4645-aca5-0caf948a7787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:27 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] Volume 8d6abe1d-58c4-4c3c-8a8b-38a142b6298c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d6abe1d-58c4-4c3c-8a8b-38a142b6298c', 'volume_size': 1} Sep 01 02:07:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1353584388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d6abe1d-58c4-4c3c-8a8b-38a142b6298c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6f3634d3844515a8d81b08fb7021c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:27Z,use_quota=True,user_id='c8809e5aebf1410c8c470dbab2925b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:07:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] Creating volume 8d6abe1d-58c4-4c3c-8a8b-38a142b6298c {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:07:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:07:27 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:07:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8d6abe1d-58c4-4c3c-8a8b-38a142b6298c 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:27 devstack sudo[98788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8d6abe1d-58c4-4c3c-8a8b-38a142b6298c 1073741824 Sep 01 02:07:27 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:28 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8d6abe1d-58c4-4c3c-8a8b-38a142b6298c 1073741824" returned: 0 in 0.782s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8d6abe1d-58c4-4c3c-8a8b-38a142b6298c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:28 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8d6abe1d-58c4-4c3c-8a8b-38a142b6298c Sep 01 02:07:28 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:28 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-9851c2b9-d4c0-4795-8328-834b65098ab0 tempest-GroupsV320Test-840264238 None] Group tempest-GroupsV320Test-Group-1751484487: creating Sep 01 02:07:28 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-9851c2b9-d4c0-4795-8328-834b65098ab0 tempest-GroupsV320Test-840264238 None] Group tempest-GroupsV320Test-Group-1751484487: created successfully Sep 01 02:07:28 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-9851c2b9-d4c0-4795-8328-834b65098ab0 tempest-GroupsV320Test-840264238 None] Create group completed successfully. Sep 01 02:07:28 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8d6abe1d-58c4-4c3c-8a8b-38a142b6298c" returned: 0 in 0.502s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:28 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:07:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14428832-526b-4645-aca5-0caf948a7787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d6abe1d-58c4-4c3c-8a8b-38a142b6298c', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eacbfe83-3912-46de-9367-98030f619c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:28 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] Volume volume-8d6abe1d-58c4-4c3c-8a8b-38a142b6298c (8d6abe1d-58c4-4c3c-8a8b-38a142b6298c): created successfully Sep 01 02:07:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eacbfe83-3912-46de-9367-98030f619c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] Flow 'volume_create_manager' (71bf5d60-9b15-4f5f-97aa-f4d379f5d479) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:28 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-a421d012-e39f-4e5e-b0ab-54d3f4e8e580 tempest-VolumesTransfersV355Test-1409290266 None] Created volume successfully. Sep 01 02:07:30 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-6a6747bd-3ff2-44be-8bd9-c9e6d95ce688 tempest-VolumesTransfersV355Test-1306337213 None] Transfer volume completed successfully. Sep 01 02:07:30 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-8bf217a6-90f3-4978-b8be-6edc4f6f51fe tempest-GroupsV320Test-840264238 None] Created reservations ['29a0e780-5288-4747-8d03-96eda425e872'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8bf217a6-90f3-4978-b8be-6edc4f6f51fe tempest-GroupsV320Test-840264238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8bf217a6-90f3-4978-b8be-6edc4f6f51fe tempest-GroupsV320Test-840264238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8bf217a6-90f3-4978-b8be-6edc4f6f51fe tempest-GroupsV320Test-840264238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8bf217a6-90f3-4978-b8be-6edc4f6f51fe tempest-GroupsV320Test-840264238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8bf217a6-90f3-4978-b8be-6edc4f6f51fe tempest-GroupsV320Test-840264238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8bf217a6-90f3-4978-b8be-6edc4f6f51fe tempest-GroupsV320Test-840264238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:30 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:07:30 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:31 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8bf217a6-90f3-4978-b8be-6edc4f6f51fe tempest-GroupsV320Test-840264238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.669s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:31 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-8bf217a6-90f3-4978-b8be-6edc4f6f51fe tempest-GroupsV320Test-840264238 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:31 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-8bf217a6-90f3-4978-b8be-6edc4f6f51fe tempest-GroupsV320Test-840264238 None] Delete group completed successfully. Sep 01 02:07:31 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c80b54e8-e35f-4053-8a67-5559f363f940 tempest-VolumesTransfersV355Test-1299903674 None] Acquiring lock "cinder-8d6abe1d-58c4-4c3c-8a8b-38a142b6298c-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:31 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c80b54e8-e35f-4053-8a67-5559f363f940 tempest-VolumesTransfersV355Test-1299903674 None] Lock "cinder-8d6abe1d-58c4-4c3c-8a8b-38a142b6298c-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:31 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c80b54e8-e35f-4053-8a67-5559f363f940 tempest-VolumesTransfersV355Test-1299903674 None] Acquiring lock "cinder-quobyte-8d6abe1d-58c4-4c3c-8a8b-38a142b6298c" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:31 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c80b54e8-e35f-4053-8a67-5559f363f940 tempest-VolumesTransfersV355Test-1299903674 None] Lock "cinder-quobyte-8d6abe1d-58c4-4c3c-8a8b-38a142b6298c" acquired by "delete_volume" :: waited 0.023s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:31 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a1fb7b-8a76-4022-88b6-51a17aebfb2b]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c80b54e8-e35f-4053-8a67-5559f363f940 tempest-VolumesTransfersV355Test-1299903674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8d6abe1d-58c4-4c3c-8a8b-38a142b6298c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:32 devstack sudo[98805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8d6abe1d-58c4-4c3c-8a8b-38a142b6298c Sep 01 02:07:32 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:32 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c80b54e8-e35f-4053-8a67-5559f363f940 tempest-VolumesTransfersV355Test-1299903674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8d6abe1d-58c4-4c3c-8a8b-38a142b6298c" returned: 0 in 0.629s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c80b54e8-e35f-4053-8a67-5559f363f940 tempest-VolumesTransfersV355Test-1299903674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8d6abe1d-58c4-4c3c-8a8b-38a142b6298c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:32 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8d6abe1d-58c4-4c3c-8a8b-38a142b6298c Sep 01 02:07:32 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:32 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c80b54e8-e35f-4053-8a67-5559f363f940 tempest-VolumesTransfersV355Test-1299903674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8d6abe1d-58c4-4c3c-8a8b-38a142b6298c" returned: 0 in 0.297s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:32 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c80b54e8-e35f-4053-8a67-5559f363f940 tempest-VolumesTransfersV355Test-1299903674 None] Lock "cinder-quobyte-8d6abe1d-58c4-4c3c-8a8b-38a142b6298c" released by "delete_volume" :: held 1.010s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:33 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-c80b54e8-e35f-4053-8a67-5559f363f940 tempest-VolumesTransfersV355Test-1299903674 None] Created reservations ['03f03597-933d-4c7a-a16b-4c34f491abb6', '9b97cf5e-8ce3-49ca-a8fd-06d0ea678feb', 'c0f40c95-5ebf-4e55-87e2-0e64f8739a3c', '593eac49-70e1-4261-a36e-b610a7390774'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c80b54e8-e35f-4053-8a67-5559f363f940 tempest-VolumesTransfersV355Test-1299903674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c80b54e8-e35f-4053-8a67-5559f363f940 tempest-VolumesTransfersV355Test-1299903674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c80b54e8-e35f-4053-8a67-5559f363f940 tempest-VolumesTransfersV355Test-1299903674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c80b54e8-e35f-4053-8a67-5559f363f940 tempest-VolumesTransfersV355Test-1299903674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c80b54e8-e35f-4053-8a67-5559f363f940 tempest-VolumesTransfersV355Test-1299903674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c80b54e8-e35f-4053-8a67-5559f363f940 tempest-VolumesTransfersV355Test-1299903674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:33 devstack sudo[98813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:07:33 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:33 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c80b54e8-e35f-4053-8a67-5559f363f940 tempest-VolumesTransfersV355Test-1299903674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.385s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:33 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-c80b54e8-e35f-4053-8a67-5559f363f940 tempest-VolumesTransfersV355Test-1299903674 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:33 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-c80b54e8-e35f-4053-8a67-5559f363f940 tempest-VolumesTransfersV355Test-1299903674 None] Deleted volume successfully. Sep 01 02:07:33 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c80b54e8-e35f-4053-8a67-5559f363f940 tempest-VolumesTransfersV355Test-1299903674 None] Lock "cinder-8d6abe1d-58c4-4c3c-8a8b-38a142b6298c-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:35 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:35 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] Flow 'volume_create_manager' (2fcfa880-7cbc-472e-8700-cf089081668c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:35 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926a2d91-f3b9-40b4-808b-06a6e335bd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:35 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926a2d91-f3b9-40b4-808b-06a6e335bd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-758827522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59b10304-5775-4586-a191-d98e8b14c259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6f3634d3844515a8d81b08fb7021c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:35Z,use_quota=True,user_id='c8809e5aebf1410c8c470dbab2925b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:35 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87baca92-b52b-4681-8436-d3ad7815f054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:35 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87baca92-b52b-4681-8436-d3ad7815f054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:35 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c67d5b8-3c2c-4816-a61e-c3051f78838f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:35 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c67d5b8-3c2c-4816-a61e-c3051f78838f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59b10304-5775-4586-a191-d98e8b14c259', 'volume_name': 'volume-59b10304-5775-4586-a191-d98e8b14c259', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:35 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b189b98-fe59-4699-bf3c-b0c09cf8af63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:35 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b189b98-fe59-4699-bf3c-b0c09cf8af63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:35 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a43a06-886f-46b7-aed3-5e613fd0460d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:35 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] Volume 59b10304-5775-4586-a191-d98e8b14c259: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59b10304-5775-4586-a191-d98e8b14c259', 'volume_size': 1} Sep 01 02:07:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:35 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-758827522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59b10304-5775-4586-a191-d98e8b14c259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6f3634d3844515a8d81b08fb7021c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:35Z,use_quota=True,user_id='c8809e5aebf1410c8c470dbab2925b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:07:35 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] Creating volume 59b10304-5775-4586-a191-d98e8b14c259 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:07:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:35 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:35 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:35 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:07:35 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:07:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59b10304-5775-4586-a191-d98e8b14c259 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:35 devstack sudo[98816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59b10304-5775-4586-a191-d98e8b14c259 1073741824 Sep 01 02:07:35 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:35 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59b10304-5775-4586-a191-d98e8b14c259 1073741824" returned: 0 in 0.586s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59b10304-5775-4586-a191-d98e8b14c259 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:35 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59b10304-5775-4586-a191-d98e8b14c259 Sep 01 02:07:35 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:36 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59b10304-5775-4586-a191-d98e8b14c259" returned: 0 in 0.360s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:36 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:07:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a43a06-886f-46b7-aed3-5e613fd0460d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59b10304-5775-4586-a191-d98e8b14c259', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d011cf4-c682-40ae-ad65-efffbf06bd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:36 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] Volume volume-59b10304-5775-4586-a191-d98e8b14c259 (59b10304-5775-4586-a191-d98e8b14c259): created successfully Sep 01 02:07:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d011cf4-c682-40ae-ad65-efffbf06bd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] Flow 'volume_create_manager' (2fcfa880-7cbc-472e-8700-cf089081668c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:36 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-1e36de6a-a856-49d2-b87b-c94a7f80fb45 tempest-VolumesTransfersV355Test-1409290266 None] Created volume successfully. Sep 01 02:07:37 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f75f54d7-eee7-4279-ae5f-50ed45c65de7 tempest-VolumesTransfersV355Test-1299903674 None] Acquiring lock "cinder-59b10304-5775-4586-a191-d98e8b14c259-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:37 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f75f54d7-eee7-4279-ae5f-50ed45c65de7 tempest-VolumesTransfersV355Test-1299903674 None] Lock "cinder-59b10304-5775-4586-a191-d98e8b14c259-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:37 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f75f54d7-eee7-4279-ae5f-50ed45c65de7 tempest-VolumesTransfersV355Test-1299903674 None] Acquiring lock "cinder-quobyte-59b10304-5775-4586-a191-d98e8b14c259" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:37 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f75f54d7-eee7-4279-ae5f-50ed45c65de7 tempest-VolumesTransfersV355Test-1299903674 None] Lock "cinder-quobyte-59b10304-5775-4586-a191-d98e8b14c259" acquired by "delete_volume" :: waited 0.024s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:37 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f39771-1249-4e65-9aee-f1d94b320526]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f75f54d7-eee7-4279-ae5f-50ed45c65de7 tempest-VolumesTransfersV355Test-1299903674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59b10304-5775-4586-a191-d98e8b14c259 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:37 devstack sudo[98824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59b10304-5775-4586-a191-d98e8b14c259 Sep 01 02:07:37 devstack sudo[98824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:38 devstack sudo[98824]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f75f54d7-eee7-4279-ae5f-50ed45c65de7 tempest-VolumesTransfersV355Test-1299903674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59b10304-5775-4586-a191-d98e8b14c259" returned: 0 in 0.475s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f75f54d7-eee7-4279-ae5f-50ed45c65de7 tempest-VolumesTransfersV355Test-1299903674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59b10304-5775-4586-a191-d98e8b14c259 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:38 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59b10304-5775-4586-a191-d98e8b14c259 Sep 01 02:07:38 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:38 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f75f54d7-eee7-4279-ae5f-50ed45c65de7 tempest-VolumesTransfersV355Test-1299903674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59b10304-5775-4586-a191-d98e8b14c259" returned: 0 in 0.382s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:38 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f75f54d7-eee7-4279-ae5f-50ed45c65de7 tempest-VolumesTransfersV355Test-1299903674 None] Lock "cinder-quobyte-59b10304-5775-4586-a191-d98e8b14c259" released by "delete_volume" :: held 0.926s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:38 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-f75f54d7-eee7-4279-ae5f-50ed45c65de7 tempest-VolumesTransfersV355Test-1299903674 None] Created reservations ['20a5e8cf-0bca-4813-af43-fe47628cbc4e', 'a4f5a829-d2d5-4a97-b087-97896c8c3db5', 'a4f38923-411e-4b77-9add-5563b0c6cb37', '3986e4d3-c651-4608-83dc-1a1023c79e30'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f75f54d7-eee7-4279-ae5f-50ed45c65de7 tempest-VolumesTransfersV355Test-1299903674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f75f54d7-eee7-4279-ae5f-50ed45c65de7 tempest-VolumesTransfersV355Test-1299903674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:38 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f75f54d7-eee7-4279-ae5f-50ed45c65de7 tempest-VolumesTransfersV355Test-1299903674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:38 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f75f54d7-eee7-4279-ae5f-50ed45c65de7 tempest-VolumesTransfersV355Test-1299903674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f75f54d7-eee7-4279-ae5f-50ed45c65de7 tempest-VolumesTransfersV355Test-1299903674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f75f54d7-eee7-4279-ae5f-50ed45c65de7 tempest-VolumesTransfersV355Test-1299903674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:38 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:07:38 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:39 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f75f54d7-eee7-4279-ae5f-50ed45c65de7 tempest-VolumesTransfersV355Test-1299903674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.471s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:39 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-f75f54d7-eee7-4279-ae5f-50ed45c65de7 tempest-VolumesTransfersV355Test-1299903674 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:39 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-f75f54d7-eee7-4279-ae5f-50ed45c65de7 tempest-VolumesTransfersV355Test-1299903674 None] Deleted volume successfully. Sep 01 02:07:39 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f75f54d7-eee7-4279-ae5f-50ed45c65de7 tempest-VolumesTransfersV355Test-1299903674 None] Lock "cinder-59b10304-5775-4586-a191-d98e8b14c259-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Flow 'volume_create_manager' (dadc76cd-a061-4b28-87d1-2488a9032932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c109f309-948d-42ea-8f09-51208a115069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c109f309-948d-42ea-8f09-51208a115069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1985806648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c11d0b-8eb7-4514-be3c-7a4f92120ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97445fc80e714e61bc8c7f92397eba7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:48Z,use_quota=True,user_id='70253b7bb5d7424285cf18a54ea490d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a981a04e-c832-410b-a80c-aa6425a34580),volume_type_id=a981a04e-c832-410b-a80c-aa6425a34580)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (922f36ed-c675-49f0-8422-fa221e8a850b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (922f36ed-c675-49f0-8422-fa221e8a850b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6beaa874-b46f-4280-83d1-9f67f537a086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6beaa874-b46f-4280-83d1-9f67f537a086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5c11d0b-8eb7-4514-be3c-7a4f92120ac1', 'volume_name': 'volume-a5c11d0b-8eb7-4514-be3c-7a4f92120ac1', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bebf3c60-55e3-431d-93b5-06de8ef5a7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bebf3c60-55e3-431d-93b5-06de8ef5a7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4368aac-4e7b-4456-8c04-7d81803ef991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:48 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Volume a5c11d0b-8eb7-4514-be3c-7a4f92120ac1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5c11d0b-8eb7-4514-be3c-7a4f92120ac1', 'volume_size': 1} Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1985806648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c11d0b-8eb7-4514-be3c-7a4f92120ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97445fc80e714e61bc8c7f92397eba7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:48Z,use_quota=True,user_id='70253b7bb5d7424285cf18a54ea490d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a981a04e-c832-410b-a80c-aa6425a34580),volume_type_id=a981a04e-c832-410b-a80c-aa6425a34580)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Creating volume a5c11d0b-8eb7-4514-be3c-7a4f92120ac1 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:07:48 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a5c11d0b-8eb7-4514-be3c-7a4f92120ac1 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:48 devstack sudo[98874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a5c11d0b-8eb7-4514-be3c-7a4f92120ac1 1073741824 Sep 01 02:07:48 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:48 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a5c11d0b-8eb7-4514-be3c-7a4f92120ac1 1073741824" returned: 0 in 0.561s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Flow 'volume_create_manager' (15d86101-0825-4c2e-a686-36a8ed102853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (014ce531-0c94-49c3-b1cd-7ca2d27585e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (014ce531-0c94-49c3-b1cd-7ca2d27585e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-583096149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66139a3d-6149-4b28-9d60-c9d1ad28340f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c7e6e2bdebb4fadb363b9819c52e83a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:49Z,use_quota=True,user_id='790e9af832d44403a21c350ee8738185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99219783-61fd-4586-9734-ee1579544f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99219783-61fd-4586-9734-ee1579544f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1604190-b5f2-4f46-921b-0093fa0a2736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG cinder.image.glance [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Creating Keystone auth plugin from conf {{(pid=87128) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:07:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a5c11d0b-8eb7-4514-be3c-7a4f92120ac1 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:48 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a5c11d0b-8eb7-4514-be3c-7a4f92120ac1 Sep 01 02:07:48 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1604190-b5f2-4f46-921b-0093fa0a2736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '66139a3d-6149-4b28-9d60-c9d1ad28340f', 'volume_name': 'volume-66139a3d-6149-4b28-9d60-c9d1ad28340f', 'volume_size': 1, 'image_id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64fc298b-4656-41e6-a52e-bd149cb491e9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0dbd8f0a33a74d5db3271102e89b70d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'created_at': datetime.datetime(2026, 8, 31, 23, 51, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 51, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64fc298b-4656-41e6-a52e-bd149cb491e9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b52a2c3-6acb-4343-8f11-7581d37073c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b52a2c3-6acb-4343-8f11-7581d37073c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef8406a7-585f-4e2a-beaa-1496d9480172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:49 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Volume 66139a3d-6149-4b28-9d60-c9d1ad28340f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-66139a3d-6149-4b28-9d60-c9d1ad28340f', 'volume_size': 1, 'image_id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64fc298b-4656-41e6-a52e-bd149cb491e9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0dbd8f0a33a74d5db3271102e89b70d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'created_at': datetime.datetime(2026, 8, 31, 23, 51, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 51, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64fc298b-4656-41e6-a52e-bd149cb491e9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 02:07:49 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Trying to clone 66139a3d-6149-4b28-9d60-c9d1ad28340f from image 64fc298b-4656-41e6-a52e-bd149cb491e9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/64fc298b-4656-41e6-a52e-bd149cb491e9', 'metadata': {}}]). {{(pid=87128) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:07:49 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a5c11d0b-8eb7-4514-be3c-7a4f92120ac1" returned: 0 in 0.292s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:07:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4368aac-4e7b-4456-8c04-7d81803ef991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5c11d0b-8eb7-4514-be3c-7a4f92120ac1', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ed291b-3225-4b5c-aa16-765d9531ef2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:49 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Volume volume-a5c11d0b-8eb7-4514-be3c-7a4f92120ac1 (a5c11d0b-8eb7-4514-be3c-7a4f92120ac1): created successfully Sep 01 02:07:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ed291b-3225-4b5c-aa16-765d9531ef2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Flow 'volume_create_manager' (dadc76cd-a061-4b28-87d1-2488a9032932) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:49 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-2b7052d6-70c6-45df-8e8f-759af32091e7 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Created volume successfully. Sep 01 02:07:49 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_bfu5sgosdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87128) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:07:49 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Image download 20.69 MB at 20.69 MB/s Sep 01 02:07:49 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc051d7-8597-41ef-8fec-d081471b349a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_bfu5sgosdevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:49 devstack sudo[98884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_bfu5sgosdevstack@QuobyteHD Sep 01 02:07:49 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:49 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_bfu5sgosdevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:49 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Temporary image 64fc298b-4656-41e6-a52e-bd149cb491e9 is fetched for user 790e9af832d44403a21c350ee8738185. {{(pid=87128) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:07:50 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e168b9-03dc-47a2-876d-832fb48a791d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_bfu5sgosdevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:50 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_bfu5sgosdevstack@QuobyteHD Sep 01 02:07:50 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:50 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1b6b8f9f-6164-4280-b52e-6f68b7b05721 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1b6b8f9f-6164-4280-b52e-6f68b7b05721 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:50 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1b6b8f9f-6164-4280-b52e-6f68b7b05721 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:50 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1b6b8f9f-6164-4280-b52e-6f68b7b05721 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1b6b8f9f-6164-4280-b52e-6f68b7b05721 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1b6b8f9f-6164-4280-b52e-6f68b7b05721 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_bfu5sgosdevstack@QuobyteHD" returned: 0 in 0.476s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:50 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-583096149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66139a3d-6149-4b28-9d60-c9d1ad28340f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c7e6e2bdebb4fadb363b9819c52e83a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:49Z,use_quota=True,user_id='790e9af832d44403a21c350ee8738185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:07:50 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Creating volume 66139a3d-6149-4b28-9d60-c9d1ad28340f {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:07:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:50 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:50 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:50 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:07:50 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:07:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-66139a3d-6149-4b28-9d60-c9d1ad28340f 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:50 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:07:50 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:50 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-66139a3d-6149-4b28-9d60-c9d1ad28340f 1073741824 Sep 01 02:07:50 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:50 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1b6b8f9f-6164-4280-b52e-6f68b7b05721 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.304s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:50 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-1b6b8f9f-6164-4280-b52e-6f68b7b05721 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:50 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-1b6b8f9f-6164-4280-b52e-6f68b7b05721 tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Retype volume completed successfully. Sep 01 02:07:51 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-66139a3d-6149-4b28-9d60-c9d1ad28340f 1073741824" returned: 0 in 0.494s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-66139a3d-6149-4b28-9d60-c9d1ad28340f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:51 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-66139a3d-6149-4b28-9d60-c9d1ad28340f Sep 01 02:07:51 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:51 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-66139a3d-6149-4b28-9d60-c9d1ad28340f" returned: 0 in 0.263s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:51 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:07:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:51 devstack cinder-volume[87128]: DEBUG cinder.volume.volume_utils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Attempting download of 64fc298b-4656-41e6-a52e-bd149cb491e9 ((None, [{'url': 'file:///opt/stack/data/glance/images/64fc298b-4656-41e6-a52e-bd149cb491e9', 'metadata': {}}])) to volume 66139a3d-6149-4b28-9d60-c9d1ad28340f. {{(pid=87128) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:07:51 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a35ca6a-b6a9-492f-9dbc-7477dd9b46e9]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_t79kqcvd {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:51 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_t79kqcvd Sep 01 02:07:51 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e800aa07-7593-4f26-910e-9945a9b9e83a tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Acquiring lock "cinder-a5c11d0b-8eb7-4514-be3c-7a4f92120ac1-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e800aa07-7593-4f26-910e-9945a9b9e83a tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Lock "cinder-a5c11d0b-8eb7-4514-be3c-7a4f92120ac1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e800aa07-7593-4f26-910e-9945a9b9e83a tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Acquiring lock "cinder-quobyte-a5c11d0b-8eb7-4514-be3c-7a4f92120ac1" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e800aa07-7593-4f26-910e-9945a9b9e83a tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Lock "cinder-quobyte-a5c11d0b-8eb7-4514-be3c-7a4f92120ac1" acquired by "delete_volume" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:51 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_t79kqcvd" returned: 0 in 0.480s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_t79kqcvd {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:51 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc803e4-7e40-478a-8604-ac4f6a2443ee]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e800aa07-7593-4f26-910e-9945a9b9e83a tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a5c11d0b-8eb7-4514-be3c-7a4f92120ac1 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:52 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a5c11d0b-8eb7-4514-be3c-7a4f92120ac1 Sep 01 02:07:52 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_t79kqcvd Sep 01 02:07:52 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:52 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:52 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_t79kqcvd" returned: 1 in 0.418s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_t79kqcvd' failed. Not Retrying. {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:07:52 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d1bd1a-6da2-4e4a-bac2-beb235d12ae9]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_bfu5sgosdevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:52 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e800aa07-7593-4f26-910e-9945a9b9e83a tempest-VolumeRetypeWithoutMigrationTest-8690831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a5c11d0b-8eb7-4514-be3c-7a4f92120ac1" returned: 0 in 0.509s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e800aa07-7593-4f26-910e-9945a9b9e83a tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a5c11d0b-8eb7-4514-be3c-7a4f92120ac1 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:52 devstack sudo[98922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a5c11d0b-8eb7-4514-be3c-7a4f92120ac1 Sep 01 02:07:52 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:52 devstack sudo[98920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_bfu5sgosdevstack@QuobyteHD Sep 01 02:07:52 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:52 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e800aa07-7593-4f26-910e-9945a9b9e83a tempest-VolumeRetypeWithoutMigrationTest-8690831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a5c11d0b-8eb7-4514-be3c-7a4f92120ac1" returned: 0 in 0.356s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:52 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e800aa07-7593-4f26-910e-9945a9b9e83a tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Lock "cinder-quobyte-a5c11d0b-8eb7-4514-be3c-7a4f92120ac1" released by "delete_volume" :: held 0.933s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_bfu5sgosdevstack@QuobyteHD" returned: 0 in 0.486s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:52 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] 64fc298b-4656-41e6-a52e-bd149cb491e9 was qcow2, converting to qcow2 {{(pid=87128) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:07:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_bfu5sgosdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-66139a3d-6149-4b28-9d60-c9d1ad28340f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:52 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_bfu5sgosdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-66139a3d-6149-4b28-9d60-c9d1ad28340f Sep 01 02:07:52 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:52 devstack cinder-volume[87128]: WARNING cinder.quota [None req-e800aa07-7593-4f26-910e-9945a9b9e83a tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:07:52 devstack cinder-volume[87128]: WARNING cinder.quota [None req-e800aa07-7593-4f26-910e-9945a9b9e83a tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:07:52 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-e800aa07-7593-4f26-910e-9945a9b9e83a tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Created reservations ['5d4f4fae-893e-45b3-bcbc-f44ddf04880e', 'af2102ad-798c-4063-9d40-364d1aa29fe2', 'e8aa009a-e1f9-4446-9524-6b0861b503e3', '714fa77a-d339-4a62-9f44-80c7ac6c3d5c'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e800aa07-7593-4f26-910e-9945a9b9e83a tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e800aa07-7593-4f26-910e-9945a9b9e83a tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e800aa07-7593-4f26-910e-9945a9b9e83a tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e800aa07-7593-4f26-910e-9945a9b9e83a tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e800aa07-7593-4f26-910e-9945a9b9e83a tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e800aa07-7593-4f26-910e-9945a9b9e83a tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:53 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:07:53 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:53 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e800aa07-7593-4f26-910e-9945a9b9e83a tempest-VolumeRetypeWithoutMigrationTest-8690831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.362s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:53 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-e800aa07-7593-4f26-910e-9945a9b9e83a tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:53 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-e800aa07-7593-4f26-910e-9945a9b9e83a tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Deleted volume successfully. Sep 01 02:07:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e800aa07-7593-4f26-910e-9945a9b9e83a tempest-VolumeRetypeWithoutMigrationTest-8690831 None] Lock "cinder-a5c11d0b-8eb7-4514-be3c-7a4f92120ac1-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:55 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_bfu5sgosdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-66139a3d-6149-4b28-9d60-c9d1ad28340f" returned: 0 in 2.344s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:55 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_bfu5sgosdevstack@QuobyteHD, size 112.00 MB, duration 2.35 sec, destination /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-66139a3d-6149-4b28-9d60-c9d1ad28340f {{(pid=87128) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:07:55 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Converted 112.00 MB image at 47.76 MB/s Sep 01 02:07:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-66139a3d-6149-4b28-9d60-c9d1ad28340f 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:55 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-66139a3d-6149-4b28-9d60-c9d1ad28340f 1G Sep 01 02:07:55 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:55 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-66139a3d-6149-4b28-9d60-c9d1ad28340f 1G" returned: 0 in 0.384s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:55 devstack cinder-volume[87128]: DEBUG cinder.volume.volume_utils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Downloaded image 64fc298b-4656-41e6-a52e-bd149cb491e9 ((None, [{'url': 'file:///opt/stack/data/glance/images/64fc298b-4656-41e6-a52e-bd149cb491e9', 'metadata': {}}])) to volume 66139a3d-6149-4b28-9d60-c9d1ad28340f successfully. {{(pid=87128) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:07:55 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Temporary image 64fc298b-4656-41e6-a52e-bd149cb491e9 for user 790e9af832d44403a21c350ee8738185 is deleted. {{(pid=87128) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:07:55 devstack cinder-volume[87128]: DEBUG cinder.volume.volume_utils [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Marking volume 66139a3d-6149-4b28-9d60-c9d1ad28340f as bootable. {{(pid=87128) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:07:55 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Copying metadata from image 64fc298b-4656-41e6-a52e-bd149cb491e9 to 66139a3d-6149-4b28-9d60-c9d1ad28340f. {{(pid=87128) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:07:55 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Creating volume glance metadata for volume 66139a3d-6149-4b28-9d60-c9d1ad28340f backed by image 64fc298b-4656-41e6-a52e-bd149cb491e9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87128) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:07:55 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef8406a7-585f-4e2a-beaa-1496d9480172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66139a3d-6149-4b28-9d60-c9d1ad28340f', 'volume_size': 1, 'image_id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64fc298b-4656-41e6-a52e-bd149cb491e9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0dbd8f0a33a74d5db3271102e89b70d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'created_at': datetime.datetime(2026, 8, 31, 23, 51, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 51, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64fc298b-4656-41e6-a52e-bd149cb491e9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:55 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7fadf0-7dd2-48d0-93a9-f99cb64209a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:55 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Volume volume-66139a3d-6149-4b28-9d60-c9d1ad28340f (66139a3d-6149-4b28-9d60-c9d1ad28340f): created successfully Sep 01 02:07:55 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7fadf0-7dd2-48d0-93a9-f99cb64209a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:55 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Flow 'volume_create_manager' (15d86101-0825-4c2e-a686-36a8ed102853) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:55 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-518cd987-ead9-45c9-af5f-c50c8b2e724f tempest-VolumesExtendTest-1762089706 None] Created volume successfully. Sep 01 02:07:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-13955f37-edf0-41c3-8ff0-15efc44bcafb tempest-VolumesExtendTest-1762089706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-13955f37-edf0-41c3-8ff0-15efc44bcafb tempest-VolumesExtendTest-1762089706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:56 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b90d1e9-ac4a-4752-8438-3af972953337]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-13955f37-edf0-41c3-8ff0-15efc44bcafb tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-66139a3d-6149-4b28-9d60-c9d1ad28340f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:56 devstack sudo[98947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-66139a3d-6149-4b28-9d60-c9d1ad28340f Sep 01 02:07:56 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:57 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-13955f37-edf0-41c3-8ff0-15efc44bcafb tempest-VolumesExtendTest-1762089706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-66139a3d-6149-4b28-9d60-c9d1ad28340f" returned: 0 in 0.424s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-13955f37-edf0-41c3-8ff0-15efc44bcafb tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-66139a3d-6149-4b28-9d60-c9d1ad28340f 2G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-13955f37-edf0-41c3-8ff0-15efc44bcafb tempest-VolumesExtendTest-1762089706 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-66139a3d-6149-4b28-9d60-c9d1ad28340f 2G" returned: 0 in 0.125s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-13955f37-edf0-41c3-8ff0-15efc44bcafb tempest-VolumesExtendTest-1762089706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.588s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:57 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-13955f37-edf0-41c3-8ff0-15efc44bcafb tempest-VolumesExtendTest-1762089706 None] Extend volume completed successfully. Sep 01 02:07:57 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] Flow 'volume_create_manager' (62aa11fe-d902-4679-89cd-da707cf3f1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9f0db8a-de24-40bb-944a-a93a3c913919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9f0db8a-de24-40bb-944a-a93a3c913919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1104149798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb7a50bd-eb42-44e5-85b6-86df7f66c511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1489e85ed73e4b63bfe10d24dc012399',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:58Z,use_quota=True,user_id='a4a59457f03545638dd39db76b13fa66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75978239-7bf2-4b2e-a57d-f28c5eb90180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75978239-7bf2-4b2e-a57d-f28c5eb90180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e3627b-cffe-441a-834e-5e41db20504c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e3627b-cffe-441a-834e-5e41db20504c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb7a50bd-eb42-44e5-85b6-86df7f66c511', 'volume_name': 'volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44f11f64-b3da-4706-ba64-bac0db396bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44f11f64-b3da-4706-ba64-bac0db396bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26bddbae-3fb6-4f08-8e38-922f899d7778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:57 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] Volume eb7a50bd-eb42-44e5-85b6-86df7f66c511: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511', 'volume_size': 1} Sep 01 02:07:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1104149798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb7a50bd-eb42-44e5-85b6-86df7f66c511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1489e85ed73e4b63bfe10d24dc012399',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:58Z,use_quota=True,user_id='a4a59457f03545638dd39db76b13fa66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:07:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] Creating volume eb7a50bd-eb42-44e5-85b6-86df7f66c511 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:07:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:07:57 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:07:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:57 devstack sudo[98956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511 1073741824 Sep 01 02:07:57 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:58 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7c678aff-287d-4b19-9e23-0e206524f063 tempest-VolumesExtendTest-1762089706 None] Acquiring lock "cinder-66139a3d-6149-4b28-9d60-c9d1ad28340f-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:58 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7c678aff-287d-4b19-9e23-0e206524f063 tempest-VolumesExtendTest-1762089706 None] Lock "cinder-66139a3d-6149-4b28-9d60-c9d1ad28340f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:58 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7c678aff-287d-4b19-9e23-0e206524f063 tempest-VolumesExtendTest-1762089706 None] Acquiring lock "cinder-quobyte-66139a3d-6149-4b28-9d60-c9d1ad28340f" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:58 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7c678aff-287d-4b19-9e23-0e206524f063 tempest-VolumesExtendTest-1762089706 None] Lock "cinder-quobyte-66139a3d-6149-4b28-9d60-c9d1ad28340f" acquired by "delete_volume" :: waited 0.025s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:58 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb186df-91e8-40d4-a68d-dc740d5bd0f4]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7c678aff-287d-4b19-9e23-0e206524f063 tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-66139a3d-6149-4b28-9d60-c9d1ad28340f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:58 devstack sudo[98961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-66139a3d-6149-4b28-9d60-c9d1ad28340f Sep 01 02:07:58 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:58 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511 1073741824" returned: 0 in 0.605s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:58 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511 Sep 01 02:07:58 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:58 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7c678aff-287d-4b19-9e23-0e206524f063 tempest-VolumesExtendTest-1762089706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-66139a3d-6149-4b28-9d60-c9d1ad28340f" returned: 0 in 0.453s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7c678aff-287d-4b19-9e23-0e206524f063 tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-66139a3d-6149-4b28-9d60-c9d1ad28340f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:58 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-66139a3d-6149-4b28-9d60-c9d1ad28340f Sep 01 02:07:58 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:58 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511" returned: 0 in 0.363s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:07:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26bddbae-3fb6-4f08-8e38-922f899d7778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be324735-995b-4f17-aa50-78a41b7d7441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:58 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] Volume volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511 (eb7a50bd-eb42-44e5-85b6-86df7f66c511): created successfully Sep 01 02:07:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be324735-995b-4f17-aa50-78a41b7d7441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] Flow 'volume_create_manager' (62aa11fe-d902-4679-89cd-da707cf3f1ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:58 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-bc0c4be1-c93f-4032-be42-891769085616 tempest-TestStampPattern-539610372 None] Created volume successfully. Sep 01 02:07:58 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7c678aff-287d-4b19-9e23-0e206524f063 tempest-VolumesExtendTest-1762089706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-66139a3d-6149-4b28-9d60-c9d1ad28340f" returned: 0 in 0.362s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:58 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7c678aff-287d-4b19-9e23-0e206524f063 tempest-VolumesExtendTest-1762089706 None] Lock "cinder-quobyte-66139a3d-6149-4b28-9d60-c9d1ad28340f" released by "delete_volume" :: held 0.864s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:59 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-7c678aff-287d-4b19-9e23-0e206524f063 tempest-VolumesExtendTest-1762089706 None] Created reservations ['2afb4f38-d840-4842-bca3-4991c86cf647', 'a264ee23-2d3f-465d-8744-02fb2c201afb', '779428e6-dc4f-4e46-b273-0e8b654b27e5', 'c769cc59-f42c-4819-b218-bee3daf9d240'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7c678aff-287d-4b19-9e23-0e206524f063 tempest-VolumesExtendTest-1762089706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7c678aff-287d-4b19-9e23-0e206524f063 tempest-VolumesExtendTest-1762089706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:59 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7c678aff-287d-4b19-9e23-0e206524f063 tempest-VolumesExtendTest-1762089706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:59 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7c678aff-287d-4b19-9e23-0e206524f063 tempest-VolumesExtendTest-1762089706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7c678aff-287d-4b19-9e23-0e206524f063 tempest-VolumesExtendTest-1762089706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7c678aff-287d-4b19-9e23-0e206524f063 tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:59 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:07:59 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:59 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7c678aff-287d-4b19-9e23-0e206524f063 tempest-VolumesExtendTest-1762089706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.327s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:59 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-7c678aff-287d-4b19-9e23-0e206524f063 tempest-VolumesExtendTest-1762089706 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:59 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-7c678aff-287d-4b19-9e23-0e206524f063 tempest-VolumesExtendTest-1762089706 None] Deleted volume successfully. Sep 01 02:07:59 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7c678aff-287d-4b19-9e23-0e206524f063 tempest-VolumesExtendTest-1762089706 None] Lock "cinder-66139a3d-6149-4b28-9d60-c9d1ad28340f-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:59 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:59 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] Flow 'volume_create_manager' (3edd68b2-ce40-4d9c-8b4c-9101619d612e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:59 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52274748-f99b-4830-8c9f-6bed79535935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:59 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52274748-f99b-4830-8c9f-6bed79535935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1690326739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b43354b-a04e-4526-9dfc-91344448f85f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c7e6e2bdebb4fadb363b9819c52e83a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:00Z,use_quota=True,user_id='790e9af832d44403a21c350ee8738185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:59 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf249963-47f9-4783-ba7c-72c3dc6af099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:59 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf249963-47f9-4783-ba7c-72c3dc6af099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:59 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51dbb65e-16d1-44cc-9b4e-723584d5ed1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51dbb65e-16d1-44cc-9b4e-723584d5ed1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b43354b-a04e-4526-9dfc-91344448f85f', 'volume_name': 'volume-9b43354b-a04e-4526-9dfc-91344448f85f', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e10b84-e2e6-465c-8b4f-86ceb36ee8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e10b84-e2e6-465c-8b4f-86ceb36ee8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d452241-7897-409b-bc82-e3e6ec283629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:00 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] Volume 9b43354b-a04e-4526-9dfc-91344448f85f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b43354b-a04e-4526-9dfc-91344448f85f', 'volume_size': 1} Sep 01 02:08:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:00 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1690326739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b43354b-a04e-4526-9dfc-91344448f85f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c7e6e2bdebb4fadb363b9819c52e83a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:00Z,use_quota=True,user_id='790e9af832d44403a21c350ee8738185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:00 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] Creating volume 9b43354b-a04e-4526-9dfc-91344448f85f {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:00 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:00 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:00 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:00 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:08:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:00 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f 1073741824 Sep 01 02:08:00 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:00 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f 1073741824" returned: 0 in 0.593s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:00 devstack sudo[98989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f Sep 01 02:08:00 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:00 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f" returned: 0 in 0.305s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:01 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d452241-7897-409b-bc82-e3e6ec283629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b43354b-a04e-4526-9dfc-91344448f85f', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292bd71d-5d25-4a8f-b9bd-bbe87453897b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:01 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] Volume volume-9b43354b-a04e-4526-9dfc-91344448f85f (9b43354b-a04e-4526-9dfc-91344448f85f): created successfully Sep 01 02:08:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292bd71d-5d25-4a8f-b9bd-bbe87453897b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] Flow 'volume_create_manager' (3edd68b2-ce40-4d9c-8b4c-9101619d612e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:01 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-6425bf07-be6c-4c4a-b503-cf44eac0aca4 tempest-VolumesExtendTest-1762089706 None] Created volume successfully. Sep 01 02:08:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-005bb23f-2fcb-424e-9048-8c92c3e09a85 tempest-VolumesExtendTest-1762089706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-005bb23f-2fcb-424e-9048-8c92c3e09a85 tempest-VolumesExtendTest-1762089706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-005bb23f-2fcb-424e-9048-8c92c3e09a85 tempest-VolumesExtendTest-1762089706 None] Creating offline snapshot 296b07a0-3b56-4977-8fc4-f80e789dd79e of volume 9b43354b-a04e-4526-9dfc-91344448f85f {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:08:02 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf9bd0b-74e6-4c8a-bcd8-cf03e99e1366]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-005bb23f-2fcb-424e-9048-8c92c3e09a85 tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:02 devstack sudo[99008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f Sep 01 02:08:02 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:02 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-005bb23f-2fcb-424e-9048-8c92c3e09a85 tempest-VolumesExtendTest-1762089706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f" returned: 0 in 0.527s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-005bb23f-2fcb-424e-9048-8c92c3e09a85 tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f.296b07a0-3b56-4977-8fc4-f80e789dd79e 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:02 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f.296b07a0-3b56-4977-8fc4-f80e789dd79e 1G Sep 01 02:08:02 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:03 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-005bb23f-2fcb-424e-9048-8c92c3e09a85 tempest-VolumesExtendTest-1762089706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f.296b07a0-3b56-4977-8fc4-f80e789dd79e 1G" returned: 0 in 0.657s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-005bb23f-2fcb-424e-9048-8c92c3e09a85 tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b43354b-a04e-4526-9dfc-91344448f85f -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f.296b07a0-3b56-4977-8fc4-f80e789dd79e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:03 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b43354b-a04e-4526-9dfc-91344448f85f -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f.296b07a0-3b56-4977-8fc4-f80e789dd79e Sep 01 02:08:03 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:04 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-005bb23f-2fcb-424e-9048-8c92c3e09a85 tempest-VolumesExtendTest-1762089706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b43354b-a04e-4526-9dfc-91344448f85f -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f.296b07a0-3b56-4977-8fc4-f80e789dd79e" returned: 0 in 0.602s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:04 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-005bb23f-2fcb-424e-9048-8c92c3e09a85 tempest-VolumesExtendTest-1762089706 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f.296b07a0-3b56-4977-8fc4-f80e789dd79e is being set with open permissions: ugo+rw Sep 01 02:08:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-005bb23f-2fcb-424e-9048-8c92c3e09a85 tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f.296b07a0-3b56-4977-8fc4-f80e789dd79e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:04 devstack sudo[99085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f.296b07a0-3b56-4977-8fc4-f80e789dd79e Sep 01 02:08:04 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:04 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-005bb23f-2fcb-424e-9048-8c92c3e09a85 tempest-VolumesExtendTest-1762089706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f.296b07a0-3b56-4977-8fc4-f80e789dd79e" returned: 0 in 0.504s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:04 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:UPDATE=100,cinder:DELETE=7,cinder:SELECT=92,cinder:INSERT=32 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:08:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-005bb23f-2fcb-424e-9048-8c92c3e09a85 tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:04 devstack sudo[99092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f.info Sep 01 02:08:04 devstack sudo[99092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:04 devstack sudo[99092]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-005bb23f-2fcb-424e-9048-8c92c3e09a85 tempest-VolumesExtendTest-1762089706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f.info" returned: 0 in 0.298s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:04 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-005bb23f-2fcb-424e-9048-8c92c3e09a85 tempest-VolumesExtendTest-1762089706 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f.info is being set with open permissions: ugo+rw Sep 01 02:08:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-005bb23f-2fcb-424e-9048-8c92c3e09a85 tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:04 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f.info Sep 01 02:08:04 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:05 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-005bb23f-2fcb-424e-9048-8c92c3e09a85 tempest-VolumesExtendTest-1762089706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f.info" returned: 0 in 0.418s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-005bb23f-2fcb-424e-9048-8c92c3e09a85 tempest-VolumesExtendTest-1762089706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.192s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:05 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-005bb23f-2fcb-424e-9048-8c92c3e09a85 tempest-VolumesExtendTest-1762089706 None] Create snapshot completed successfully Sep 01 02:08:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b7f0f08b-e0ac-41fb-acee-7e32be224f4b tempest-VolumesExtendTest-1762089706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b7f0f08b-e0ac-41fb-acee-7e32be224f4b tempest-VolumesExtendTest-1762089706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:07 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8cfbba-2632-42e0-814d-bf116f09e3d2]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b7f0f08b-e0ac-41fb-acee-7e32be224f4b tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:07 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f Sep 01 02:08:07 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:07 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b7f0f08b-e0ac-41fb-acee-7e32be224f4b tempest-VolumesExtendTest-1762089706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f" returned: 0 in 0.890s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b7f0f08b-e0ac-41fb-acee-7e32be224f4b tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f.296b07a0-3b56-4977-8fc4-f80e789dd79e 2G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b7f0f08b-e0ac-41fb-acee-7e32be224f4b tempest-VolumesExtendTest-1762089706 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f.296b07a0-3b56-4977-8fc4-f80e789dd79e 2G" returned: 0 in 0.271s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b7f0f08b-e0ac-41fb-acee-7e32be224f4b tempest-VolumesExtendTest-1762089706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.234s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:08 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-b7f0f08b-e0ac-41fb-acee-7e32be224f4b tempest-VolumesExtendTest-1762089706 None] Extend volume completed successfully. Sep 01 02:08:09 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-abf4e38d-4daf-4a0c-a8e6-a4589870fd3b req-b3e0c99d-34d9-4db7-ad1d-282aa3578d05 tempest-TestShelveInstance-1570247602 None] Terminate volume connection completed successfully. Sep 01 02:08:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-abf4e38d-4daf-4a0c-a8e6-a4589870fd3b req-b3e0c99d-34d9-4db7-ad1d-282aa3578d05 tempest-TestShelveInstance-1570247602 None] Deleting attachment 4b50d788-32cd-4fcc-be5a-302bb4c5bc43. {{(pid=87128) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:08:09 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-abf4e38d-4daf-4a0c-a8e6-a4589870fd3b req-acebb744-f7cd-4009-bbd6-fcb6e218d2e9 tempest-TestShelveInstance-1570247602 None] Acquiring lock "cinder-1c53b0b6-043a-4275-afc5-6d0e749e4977-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:09 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-abf4e38d-4daf-4a0c-a8e6-a4589870fd3b req-acebb744-f7cd-4009-bbd6-fcb6e218d2e9 tempest-TestShelveInstance-1570247602 None] Lock "cinder-1c53b0b6-043a-4275-afc5-6d0e749e4977-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:09 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-d9f9da3a-2584-42a7-be7e-025a88a623ab tempest-VolumesExtendTest-1762089706 None] Acquiring lock "cinder-296b07a0-3b56-4977-8fc4-f80e789dd79e-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:09 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-d9f9da3a-2584-42a7-be7e-025a88a623ab tempest-VolumesExtendTest-1762089706 None] Lock "cinder-296b07a0-3b56-4977-8fc4-f80e789dd79e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:09 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-d9f9da3a-2584-42a7-be7e-025a88a623ab tempest-VolumesExtendTest-1762089706 None] Acquiring lock "cinder-quobyte-9b43354b-a04e-4526-9dfc-91344448f85f" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:09 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-abf4e38d-4daf-4a0c-a8e6-a4589870fd3b req-acebb744-f7cd-4009-bbd6-fcb6e218d2e9 tempest-TestShelveInstance-1570247602 None] Acquiring lock "cinder-quobyte-1c53b0b6-043a-4275-afc5-6d0e749e4977" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:09 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-d9f9da3a-2584-42a7-be7e-025a88a623ab tempest-VolumesExtendTest-1762089706 None] Lock "cinder-quobyte-9b43354b-a04e-4526-9dfc-91344448f85f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:09 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-d9f9da3a-2584-42a7-be7e-025a88a623ab tempest-VolumesExtendTest-1762089706 None] Acquiring lock "cinder-quobyte-296b07a0-3b56-4977-8fc4-f80e789dd79e" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:09 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-abf4e38d-4daf-4a0c-a8e6-a4589870fd3b req-acebb744-f7cd-4009-bbd6-fcb6e218d2e9 tempest-TestShelveInstance-1570247602 None] Lock "cinder-quobyte-1c53b0b6-043a-4275-afc5-6d0e749e4977" acquired by "delete_volume" :: waited 0.026s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:09 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf44f18-37ea-430a-9c9e-0e489b659c4c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-abf4e38d-4daf-4a0c-a8e6-a4589870fd3b req-acebb744-f7cd-4009-bbd6-fcb6e218d2e9 tempest-TestShelveInstance-1570247602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1c53b0b6-043a-4275-afc5-6d0e749e4977 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:09 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-d9f9da3a-2584-42a7-be7e-025a88a623ab tempest-VolumesExtendTest-1762089706 None] Lock "cinder-quobyte-296b07a0-3b56-4977-8fc4-f80e789dd79e" acquired by "_delete_snapshot" :: waited 0.072s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:09 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-d9f9da3a-2584-42a7-be7e-025a88a623ab tempest-VolumesExtendTest-1762089706 None] Deleting offline snapshot 296b07a0-3b56-4977-8fc4-f80e789dd79e of volume 9b43354b-a04e-4526-9dfc-91344448f85f {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:08:09 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-d9f9da3a-2584-42a7-be7e-025a88a623ab tempest-VolumesExtendTest-1762089706 None] snapshot_file for this snap is: volume-9b43354b-a04e-4526-9dfc-91344448f85f.296b07a0-3b56-4977-8fc4-f80e789dd79e {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:08:09 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec68709-e9c3-4e86-b8e5-35020ac05ec7]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d9f9da3a-2584-42a7-be7e-025a88a623ab tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f.296b07a0-3b56-4977-8fc4-f80e789dd79e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:10 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f.296b07a0-3b56-4977-8fc4-f80e789dd79e Sep 01 02:08:10 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:10 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1c53b0b6-043a-4275-afc5-6d0e749e4977 Sep 01 02:08:10 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:10 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-abf4e38d-4daf-4a0c-a8e6-a4589870fd3b req-acebb744-f7cd-4009-bbd6-fcb6e218d2e9 tempest-TestShelveInstance-1570247602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1c53b0b6-043a-4275-afc5-6d0e749e4977" returned: 0 in 0.742s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-abf4e38d-4daf-4a0c-a8e6-a4589870fd3b req-acebb744-f7cd-4009-bbd6-fcb6e218d2e9 tempest-TestShelveInstance-1570247602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1c53b0b6-043a-4275-afc5-6d0e749e4977 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:10 devstack sudo[99149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1c53b0b6-043a-4275-afc5-6d0e749e4977 Sep 01 02:08:10 devstack sudo[99149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:10 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d9f9da3a-2584-42a7-be7e-025a88a623ab tempest-VolumesExtendTest-1762089706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f.296b07a0-3b56-4977-8fc4-f80e789dd79e" returned: 0 in 0.947s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:10 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-d9f9da3a-2584-42a7-be7e-025a88a623ab tempest-VolumesExtendTest-1762089706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b43354b-a04e-4526-9dfc-91344448f85f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:08:10 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6c38a2-a4e7-4e59-8eb8-6f7e805cbfbe]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d9f9da3a-2584-42a7-be7e-025a88a623ab tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:10 devstack sudo[99149]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-abf4e38d-4daf-4a0c-a8e6-a4589870fd3b req-acebb744-f7cd-4009-bbd6-fcb6e218d2e9 tempest-TestShelveInstance-1570247602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1c53b0b6-043a-4275-afc5-6d0e749e4977" returned: 0 in 0.436s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-abf4e38d-4daf-4a0c-a8e6-a4589870fd3b req-acebb744-f7cd-4009-bbd6-fcb6e218d2e9 tempest-TestShelveInstance-1570247602 None] Lock "cinder-quobyte-1c53b0b6-043a-4275-afc5-6d0e749e4977" released by "delete_volume" :: held 1.249s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:11 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f Sep 01 02:08:11 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:11 devstack cinder-volume[87128]: DEBUG cinder.quota [req-abf4e38d-4daf-4a0c-a8e6-a4589870fd3b req-acebb744-f7cd-4009-bbd6-fcb6e218d2e9 tempest-TestShelveInstance-1570247602 None] Created reservations ['5f194e8e-e01f-4ec0-bd08-aafbbbd7629f', 'e8c6b2f4-0844-4ef7-beea-7d308edb293c', 'eeda7a5f-d343-44bf-aaec-eb14617cca09', 'd03ae30d-6a83-483b-94e9-a2e3e06db90e'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-abf4e38d-4daf-4a0c-a8e6-a4589870fd3b req-acebb744-f7cd-4009-bbd6-fcb6e218d2e9 tempest-TestShelveInstance-1570247602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-abf4e38d-4daf-4a0c-a8e6-a4589870fd3b req-acebb744-f7cd-4009-bbd6-fcb6e218d2e9 tempest-TestShelveInstance-1570247602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:11 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [req-abf4e38d-4daf-4a0c-a8e6-a4589870fd3b req-acebb744-f7cd-4009-bbd6-fcb6e218d2e9 tempest-TestShelveInstance-1570247602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:11 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [req-abf4e38d-4daf-4a0c-a8e6-a4589870fd3b req-acebb744-f7cd-4009-bbd6-fcb6e218d2e9 tempest-TestShelveInstance-1570247602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-abf4e38d-4daf-4a0c-a8e6-a4589870fd3b req-acebb744-f7cd-4009-bbd6-fcb6e218d2e9 tempest-TestShelveInstance-1570247602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-abf4e38d-4daf-4a0c-a8e6-a4589870fd3b req-acebb744-f7cd-4009-bbd6-fcb6e218d2e9 tempest-TestShelveInstance-1570247602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:11 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:08:11 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:11 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d9f9da3a-2584-42a7-be7e-025a88a623ab tempest-VolumesExtendTest-1762089706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f" returned: 0 in 0.558s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d9f9da3a-2584-42a7-be7e-025a88a623ab tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f.296b07a0-3b56-4977-8fc4-f80e789dd79e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:11 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f.296b07a0-3b56-4977-8fc4-f80e789dd79e Sep 01 02:08:11 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:11 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [req-abf4e38d-4daf-4a0c-a8e6-a4589870fd3b req-acebb744-f7cd-4009-bbd6-fcb6e218d2e9 tempest-TestShelveInstance-1570247602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.415s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:11 devstack cinder-volume[87128]: DEBUG cinder.manager [req-abf4e38d-4daf-4a0c-a8e6-a4589870fd3b req-acebb744-f7cd-4009-bbd6-fcb6e218d2e9 tempest-TestShelveInstance-1570247602 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:11 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-abf4e38d-4daf-4a0c-a8e6-a4589870fd3b req-acebb744-f7cd-4009-bbd6-fcb6e218d2e9 tempest-TestShelveInstance-1570247602 None] Deleted volume successfully. Sep 01 02:08:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [req-abf4e38d-4daf-4a0c-a8e6-a4589870fd3b req-acebb744-f7cd-4009-bbd6-fcb6e218d2e9 tempest-TestShelveInstance-1570247602 None] Lock "cinder-1c53b0b6-043a-4275-afc5-6d0e749e4977-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:12 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d9f9da3a-2584-42a7-be7e-025a88a623ab tempest-VolumesExtendTest-1762089706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f.296b07a0-3b56-4977-8fc4-f80e789dd79e" returned: 0 in 0.598s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d9f9da3a-2584-42a7-be7e-025a88a623ab tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f.296b07a0-3b56-4977-8fc4-f80e789dd79e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:12 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f.296b07a0-3b56-4977-8fc4-f80e789dd79e Sep 01 02:08:12 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:12 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d9f9da3a-2584-42a7-be7e-025a88a623ab tempest-VolumesExtendTest-1762089706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f.296b07a0-3b56-4977-8fc4-f80e789dd79e" returned: 0 in 0.349s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:12 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-d9f9da3a-2584-42a7-be7e-025a88a623ab tempest-VolumesExtendTest-1762089706 None] Lock "cinder-quobyte-296b07a0-3b56-4977-8fc4-f80e789dd79e" released by "_delete_snapshot" :: held 2.619s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:12 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-d9f9da3a-2584-42a7-be7e-025a88a623ab tempest-VolumesExtendTest-1762089706 None] Lock "cinder-quobyte-9b43354b-a04e-4526-9dfc-91344448f85f" released by "delete_snapshot" :: held 2.709s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:12 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-d9f9da3a-2584-42a7-be7e-025a88a623ab tempest-VolumesExtendTest-1762089706 None] Created reservations ['75fb125a-42bd-41d5-a14e-6842ec453099', '6bc0b354-dc9d-4d65-93cc-e1dcbee33f85', '1d356fe7-8559-4610-830c-20186cb81331', 'd8f6eaff-4802-4f03-bd8d-5c5d4c598781'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:12 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-d9f9da3a-2584-42a7-be7e-025a88a623ab tempest-VolumesExtendTest-1762089706 None] Delete snapshot completed successfully. Sep 01 02:08:12 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-d9f9da3a-2584-42a7-be7e-025a88a623ab tempest-VolumesExtendTest-1762089706 None] Lock "cinder-296b07a0-3b56-4977-8fc4-f80e789dd79e-delete_snapshot" released by "delete_snapshot" :: held 2.909s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:13 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e3b7e067-e4fa-42e1-89f0-306a86b3c0f5 tempest-VolumesExtendTest-1762089706 None] Acquiring lock "cinder-9b43354b-a04e-4526-9dfc-91344448f85f-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:13 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e3b7e067-e4fa-42e1-89f0-306a86b3c0f5 tempest-VolumesExtendTest-1762089706 None] Lock "cinder-9b43354b-a04e-4526-9dfc-91344448f85f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:13 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e3b7e067-e4fa-42e1-89f0-306a86b3c0f5 tempest-VolumesExtendTest-1762089706 None] Acquiring lock "cinder-quobyte-9b43354b-a04e-4526-9dfc-91344448f85f" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:13 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e3b7e067-e4fa-42e1-89f0-306a86b3c0f5 tempest-VolumesExtendTest-1762089706 None] Lock "cinder-quobyte-9b43354b-a04e-4526-9dfc-91344448f85f" acquired by "delete_volume" :: waited 0.038s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:13 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[09536323-9866-41ea-a0b7-77b5d7931505]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e3b7e067-e4fa-42e1-89f0-306a86b3c0f5 tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:13 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f Sep 01 02:08:13 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:14 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e3b7e067-e4fa-42e1-89f0-306a86b3c0f5 tempest-VolumesExtendTest-1762089706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f" returned: 0 in 0.681s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e3b7e067-e4fa-42e1-89f0-306a86b3c0f5 tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:14 devstack sudo[99181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f Sep 01 02:08:14 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:14 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e3b7e067-e4fa-42e1-89f0-306a86b3c0f5 tempest-VolumesExtendTest-1762089706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9b43354b-a04e-4526-9dfc-91344448f85f" returned: 0 in 0.344s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:14 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e3b7e067-e4fa-42e1-89f0-306a86b3c0f5 tempest-VolumesExtendTest-1762089706 None] Lock "cinder-quobyte-9b43354b-a04e-4526-9dfc-91344448f85f" released by "delete_volume" :: held 1.152s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:14 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-e3b7e067-e4fa-42e1-89f0-306a86b3c0f5 tempest-VolumesExtendTest-1762089706 None] Created reservations ['7f846778-6c12-40a1-a853-c0a62183126b', 'e6df0b0f-5232-47af-91ad-ab7968cbd8c1', 'e0b63368-77b0-4f97-83c2-de764a5bc323', 'acc0e194-439e-4df2-9d67-0f05bbd1e750'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e3b7e067-e4fa-42e1-89f0-306a86b3c0f5 tempest-VolumesExtendTest-1762089706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e3b7e067-e4fa-42e1-89f0-306a86b3c0f5 tempest-VolumesExtendTest-1762089706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e3b7e067-e4fa-42e1-89f0-306a86b3c0f5 tempest-VolumesExtendTest-1762089706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e3b7e067-e4fa-42e1-89f0-306a86b3c0f5 tempest-VolumesExtendTest-1762089706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e3b7e067-e4fa-42e1-89f0-306a86b3c0f5 tempest-VolumesExtendTest-1762089706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e3b7e067-e4fa-42e1-89f0-306a86b3c0f5 tempest-VolumesExtendTest-1762089706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:14 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:08:14 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:14 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e3b7e067-e4fa-42e1-89f0-306a86b3c0f5 tempest-VolumesExtendTest-1762089706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.353s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:14 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-e3b7e067-e4fa-42e1-89f0-306a86b3c0f5 tempest-VolumesExtendTest-1762089706 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:14 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-e3b7e067-e4fa-42e1-89f0-306a86b3c0f5 tempest-VolumesExtendTest-1762089706 None] Deleted volume successfully. Sep 01 02:08:14 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:UPDATE=111,cinder:SELECT=101,cinder:INSERT=23,cinder:DELETE=7 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:08:15 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e3b7e067-e4fa-42e1-89f0-306a86b3c0f5 tempest-VolumesExtendTest-1762089706 None] Lock "cinder-9b43354b-a04e-4526-9dfc-91344448f85f-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:16 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:08:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:17 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:08:17 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:17 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.496s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:17 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:17 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager._thread_info {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:08:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread count: 29 {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:08:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread info: [<_MainThread(MainThread, started 128688016527488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:08:20 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] Flow 'volume_create_manager' (a0a934b5-c0fd-411d-bfe5-adaa14daf506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7099d5c-2346-4898-ad1d-f897c5a12368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7099d5c-2346-4898-ad1d-f897c5a12368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1552890107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2627f35a-9c14-4ce6-8297-3d2a6088bb8f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='595efd53a81e48ac94b48cf90c593632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:20Z,use_quota=True,user_id='25fe52acf92549549a687eb0dd4743cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feaf56e4-ce38-4e4e-ad21-070abbc10f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feaf56e4-ce38-4e4e-ad21-070abbc10f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb70c66-3a9a-4d0a-a63e-4e8fc3eb9d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb70c66-3a9a-4d0a-a63e-4e8fc3eb9d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2627f35a-9c14-4ce6-8297-3d2a6088bb8f', 'volume_name': 'volume-2627f35a-9c14-4ce6-8297-3d2a6088bb8f', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6243d0-8235-432f-9147-96737ed5ae88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6243d0-8235-432f-9147-96737ed5ae88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a9f29c-673d-40b1-a755-8effe08cf35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:20 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] Volume 2627f35a-9c14-4ce6-8297-3d2a6088bb8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2627f35a-9c14-4ce6-8297-3d2a6088bb8f', 'volume_size': 1} Sep 01 02:08:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:20 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1552890107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2627f35a-9c14-4ce6-8297-3d2a6088bb8f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='595efd53a81e48ac94b48cf90c593632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:20Z,use_quota=True,user_id='25fe52acf92549549a687eb0dd4743cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:20 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] Creating volume 2627f35a-9c14-4ce6-8297-3d2a6088bb8f {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:20 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:20 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:20 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:20 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:08:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2627f35a-9c14-4ce6-8297-3d2a6088bb8f 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:20 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2627f35a-9c14-4ce6-8297-3d2a6088bb8f 1073741824 Sep 01 02:08:20 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:20 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2627f35a-9c14-4ce6-8297-3d2a6088bb8f 1073741824" returned: 0 in 0.599s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2627f35a-9c14-4ce6-8297-3d2a6088bb8f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:20 devstack sudo[99216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2627f35a-9c14-4ce6-8297-3d2a6088bb8f Sep 01 02:08:20 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:21 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2627f35a-9c14-4ce6-8297-3d2a6088bb8f" returned: 0 in 0.344s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a9f29c-673d-40b1-a755-8effe08cf35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2627f35a-9c14-4ce6-8297-3d2a6088bb8f', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7afc5fc-e2a7-4fad-8805-7093696dd1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:21 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] Volume volume-2627f35a-9c14-4ce6-8297-3d2a6088bb8f (2627f35a-9c14-4ce6-8297-3d2a6088bb8f): created successfully Sep 01 02:08:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7afc5fc-e2a7-4fad-8805-7093696dd1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] Flow 'volume_create_manager' (a0a934b5-c0fd-411d-bfe5-adaa14daf506) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:21 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-ae6d3272-dd05-40eb-ac02-f4b140c9e6e1 tempest-VolumesGetTest-713710237 None] Created volume successfully. Sep 01 02:08:23 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:23 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] Flow 'volume_create_manager' (ced8fda6-f7cc-4000-b88e-5ad9493b8d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:23 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e38ac55-6562-4951-9195-5a74fc29de96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:23 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e38ac55-6562-4951-9195-5a74fc29de96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1139518804',display_name='tempest-VolumesGetTest-Volume-437494879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392cdb82-e772-45f7-8dfa-6522c0d5d228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='595efd53a81e48ac94b48cf90c593632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:23Z,use_quota=True,user_id='25fe52acf92549549a687eb0dd4743cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:23 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (882ab422-db16-4a78-b640-c51011126123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:23 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (882ab422-db16-4a78-b640-c51011126123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:23 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b994192-8960-4cd2-8079-7ddb750c864b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:23 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b994192-8960-4cd2-8079-7ddb750c864b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '392cdb82-e772-45f7-8dfa-6522c0d5d228', 'volume_name': 'volume-392cdb82-e772-45f7-8dfa-6522c0d5d228', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:23 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de549faa-1250-4831-8c9f-435b1905fcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:23 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de549faa-1250-4831-8c9f-435b1905fcb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:23 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd20e07-dc8f-48e2-8e9f-524259694bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:23 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] Volume 392cdb82-e772-45f7-8dfa-6522c0d5d228: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-392cdb82-e772-45f7-8dfa-6522c0d5d228', 'volume_size': 1} Sep 01 02:08:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:23 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1139518804',display_name='tempest-VolumesGetTest-Volume-437494879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392cdb82-e772-45f7-8dfa-6522c0d5d228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='595efd53a81e48ac94b48cf90c593632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:23Z,use_quota=True,user_id='25fe52acf92549549a687eb0dd4743cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:23 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] Creating volume 392cdb82-e772-45f7-8dfa-6522c0d5d228 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:23 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:23 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:23 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:23 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:08:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-392cdb82-e772-45f7-8dfa-6522c0d5d228 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:23 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-392cdb82-e772-45f7-8dfa-6522c0d5d228 1073741824 Sep 01 02:08:23 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:24 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-392cdb82-e772-45f7-8dfa-6522c0d5d228 1073741824" returned: 0 in 0.506s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-392cdb82-e772-45f7-8dfa-6522c0d5d228 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:24 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-392cdb82-e772-45f7-8dfa-6522c0d5d228 Sep 01 02:08:24 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:24 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-392cdb82-e772-45f7-8dfa-6522c0d5d228" returned: 0 in 0.460s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:24 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:24 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd20e07-dc8f-48e2-8e9f-524259694bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-392cdb82-e772-45f7-8dfa-6522c0d5d228', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:24 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c79903d4-16b6-423a-8686-dbe3b2f55159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:24 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] Volume volume-392cdb82-e772-45f7-8dfa-6522c0d5d228 (392cdb82-e772-45f7-8dfa-6522c0d5d228): created successfully Sep 01 02:08:24 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c79903d4-16b6-423a-8686-dbe3b2f55159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:24 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] Flow 'volume_create_manager' (ced8fda6-f7cc-4000-b88e-5ad9493b8d56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:24 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-87b52c1c-63b7-4a54-9fb0-c612afd7cfd9 tempest-VolumesGetTest-713710237 None] Created volume successfully. Sep 01 02:08:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-69dcb22d-3d1b-49a6-a451-b19e87cfee5a tempest-VolumesGetTest-713710237 None] Acquiring lock "cinder-392cdb82-e772-45f7-8dfa-6522c0d5d228-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-69dcb22d-3d1b-49a6-a451-b19e87cfee5a tempest-VolumesGetTest-713710237 None] Lock "cinder-392cdb82-e772-45f7-8dfa-6522c0d5d228-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-69dcb22d-3d1b-49a6-a451-b19e87cfee5a tempest-VolumesGetTest-713710237 None] Acquiring lock "cinder-quobyte-392cdb82-e772-45f7-8dfa-6522c0d5d228" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-69dcb22d-3d1b-49a6-a451-b19e87cfee5a tempest-VolumesGetTest-713710237 None] Lock "cinder-quobyte-392cdb82-e772-45f7-8dfa-6522c0d5d228" acquired by "delete_volume" :: waited 0.025s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:25 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[46174a71-556a-4317-99c9-6ffac1dced85]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-69dcb22d-3d1b-49a6-a451-b19e87cfee5a tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-392cdb82-e772-45f7-8dfa-6522c0d5d228 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:25 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-392cdb82-e772-45f7-8dfa-6522c0d5d228 Sep 01 02:08:25 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:26 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-69dcb22d-3d1b-49a6-a451-b19e87cfee5a tempest-VolumesGetTest-713710237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-392cdb82-e772-45f7-8dfa-6522c0d5d228" returned: 0 in 0.614s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-69dcb22d-3d1b-49a6-a451-b19e87cfee5a tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-392cdb82-e772-45f7-8dfa-6522c0d5d228 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:26 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-392cdb82-e772-45f7-8dfa-6522c0d5d228 Sep 01 02:08:26 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:26 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-69dcb22d-3d1b-49a6-a451-b19e87cfee5a tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-392cdb82-e772-45f7-8dfa-6522c0d5d228" returned: 0 in 0.345s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:26 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-69dcb22d-3d1b-49a6-a451-b19e87cfee5a tempest-VolumesGetTest-713710237 None] Lock "cinder-quobyte-392cdb82-e772-45f7-8dfa-6522c0d5d228" released by "delete_volume" :: held 1.017s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:26 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-69dcb22d-3d1b-49a6-a451-b19e87cfee5a tempest-VolumesGetTest-713710237 None] Created reservations ['ec82296d-8474-4d09-8b5f-5cc517388054', 'd1fdcc73-4928-4134-9d41-89610d0c0a2b', '6c1feecf-2bad-44ed-8d6c-846165164c09', '752b9026-0b69-4fe8-a032-11df7adcb5c0'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-69dcb22d-3d1b-49a6-a451-b19e87cfee5a tempest-VolumesGetTest-713710237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-69dcb22d-3d1b-49a6-a451-b19e87cfee5a tempest-VolumesGetTest-713710237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:26 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-69dcb22d-3d1b-49a6-a451-b19e87cfee5a tempest-VolumesGetTest-713710237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:26 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-69dcb22d-3d1b-49a6-a451-b19e87cfee5a tempest-VolumesGetTest-713710237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-69dcb22d-3d1b-49a6-a451-b19e87cfee5a tempest-VolumesGetTest-713710237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-69dcb22d-3d1b-49a6-a451-b19e87cfee5a tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:26 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:08:26 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:27 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-69dcb22d-3d1b-49a6-a451-b19e87cfee5a tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.322s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:27 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-69dcb22d-3d1b-49a6-a451-b19e87cfee5a tempest-VolumesGetTest-713710237 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:27 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-69dcb22d-3d1b-49a6-a451-b19e87cfee5a tempest-VolumesGetTest-713710237 None] Deleted volume successfully. Sep 01 02:08:27 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-69dcb22d-3d1b-49a6-a451-b19e87cfee5a tempest-VolumesGetTest-713710237 None] Lock "cinder-392cdb82-e772-45f7-8dfa-6522c0d5d228-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:28 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-446f0fe7-1d5a-4f6d-bdd5-15c6ecf414ef tempest-VolumesGetTest-713710237 None] Acquiring lock "cinder-2627f35a-9c14-4ce6-8297-3d2a6088bb8f-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:28 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-446f0fe7-1d5a-4f6d-bdd5-15c6ecf414ef tempest-VolumesGetTest-713710237 None] Lock "cinder-2627f35a-9c14-4ce6-8297-3d2a6088bb8f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:28 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-446f0fe7-1d5a-4f6d-bdd5-15c6ecf414ef tempest-VolumesGetTest-713710237 None] Acquiring lock "cinder-quobyte-2627f35a-9c14-4ce6-8297-3d2a6088bb8f" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:28 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-446f0fe7-1d5a-4f6d-bdd5-15c6ecf414ef tempest-VolumesGetTest-713710237 None] Lock "cinder-quobyte-2627f35a-9c14-4ce6-8297-3d2a6088bb8f" acquired by "delete_volume" :: waited 0.019s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:28 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[0355fc92-102b-49b9-8eb7-1475e2e99f8c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-446f0fe7-1d5a-4f6d-bdd5-15c6ecf414ef tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2627f35a-9c14-4ce6-8297-3d2a6088bb8f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:28 devstack sudo[99287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2627f35a-9c14-4ce6-8297-3d2a6088bb8f Sep 01 02:08:28 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:28 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-446f0fe7-1d5a-4f6d-bdd5-15c6ecf414ef tempest-VolumesGetTest-713710237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2627f35a-9c14-4ce6-8297-3d2a6088bb8f" returned: 0 in 0.424s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-446f0fe7-1d5a-4f6d-bdd5-15c6ecf414ef tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2627f35a-9c14-4ce6-8297-3d2a6088bb8f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:28 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2627f35a-9c14-4ce6-8297-3d2a6088bb8f Sep 01 02:08:28 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:28 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-446f0fe7-1d5a-4f6d-bdd5-15c6ecf414ef tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2627f35a-9c14-4ce6-8297-3d2a6088bb8f" returned: 0 in 0.276s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:28 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-446f0fe7-1d5a-4f6d-bdd5-15c6ecf414ef tempest-VolumesGetTest-713710237 None] Lock "cinder-quobyte-2627f35a-9c14-4ce6-8297-3d2a6088bb8f" released by "delete_volume" :: held 0.751s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:28 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-446f0fe7-1d5a-4f6d-bdd5-15c6ecf414ef tempest-VolumesGetTest-713710237 None] Created reservations ['030b1f6d-0219-4c5d-81ad-0db3747ef9d7', '8d7c9053-24fe-4a27-a9e3-7da9295102b9', 'a936a4e1-adab-4f3e-9475-363aac56fb25', 'd9e0f429-eea3-40c4-947d-0f6b47295d02'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-446f0fe7-1d5a-4f6d-bdd5-15c6ecf414ef tempest-VolumesGetTest-713710237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-446f0fe7-1d5a-4f6d-bdd5-15c6ecf414ef tempest-VolumesGetTest-713710237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:28 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-446f0fe7-1d5a-4f6d-bdd5-15c6ecf414ef tempest-VolumesGetTest-713710237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:28 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-446f0fe7-1d5a-4f6d-bdd5-15c6ecf414ef tempest-VolumesGetTest-713710237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-446f0fe7-1d5a-4f6d-bdd5-15c6ecf414ef tempest-VolumesGetTest-713710237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-446f0fe7-1d5a-4f6d-bdd5-15c6ecf414ef tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:29 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:08:29 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:29 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-446f0fe7-1d5a-4f6d-bdd5-15c6ecf414ef tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.452s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:29 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-446f0fe7-1d5a-4f6d-bdd5-15c6ecf414ef tempest-VolumesGetTest-713710237 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:29 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-446f0fe7-1d5a-4f6d-bdd5-15c6ecf414ef tempest-VolumesGetTest-713710237 None] Deleted volume successfully. Sep 01 02:08:29 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-446f0fe7-1d5a-4f6d-bdd5-15c6ecf414ef tempest-VolumesGetTest-713710237 None] Lock "cinder-2627f35a-9c14-4ce6-8297-3d2a6088bb8f-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:30 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] Flow 'volume_create_manager' (1306a22b-2b5d-4fe6-a41f-99443ddab1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08124845-ec0d-4299-825d-a3601dd8c85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08124845-ec0d-4299-825d-a3601dd8c85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2085759228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde6721e-4230-419f-a590-eaa86111d308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='595efd53a81e48ac94b48cf90c593632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:30Z,use_quota=True,user_id='25fe52acf92549549a687eb0dd4743cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b34da45-7f97-428b-869e-8b1952538285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b34da45-7f97-428b-869e-8b1952538285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d62cecb-7be8-485a-b8e0-12bc915e915f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d62cecb-7be8-485a-b8e0-12bc915e915f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dde6721e-4230-419f-a590-eaa86111d308', 'volume_name': 'volume-dde6721e-4230-419f-a590-eaa86111d308', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93180ff4-359c-4e5f-ba97-d88ec7c56a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93180ff4-359c-4e5f-ba97-d88ec7c56a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f09621f-805e-4a07-935c-dfab22401985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:30 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] Volume dde6721e-4230-419f-a590-eaa86111d308: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dde6721e-4230-419f-a590-eaa86111d308', 'volume_size': 1} Sep 01 02:08:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2085759228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde6721e-4230-419f-a590-eaa86111d308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='595efd53a81e48ac94b48cf90c593632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:30Z,use_quota=True,user_id='25fe52acf92549549a687eb0dd4743cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] Creating volume dde6721e-4230-419f-a590-eaa86111d308 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:30 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:08:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:30 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308 1073741824 Sep 01 02:08:30 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:30 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308 1073741824" returned: 0 in 0.504s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:30 devstack sudo[99304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308 Sep 01 02:08:30 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:30 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308" returned: 0 in 0.294s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f09621f-805e-4a07-935c-dfab22401985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dde6721e-4230-419f-a590-eaa86111d308', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05eee9f9-2c99-4cc2-9583-f8741a437364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:30 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] Volume volume-dde6721e-4230-419f-a590-eaa86111d308 (dde6721e-4230-419f-a590-eaa86111d308): created successfully Sep 01 02:08:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05eee9f9-2c99-4cc2-9583-f8741a437364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] Flow 'volume_create_manager' (1306a22b-2b5d-4fe6-a41f-99443ddab1b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:31 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-4d1fff60-b413-4c81-81be-d1e99be8b71f tempest-VolumesGetTest-713710237 None] Created volume successfully. Sep 01 02:08:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-8f9670c2-b5c8-4609-8786-d98c3aa35d09 req-6bbfdefe-cd8e-4b87-8407-297b536e6177 tempest-TestStampPattern-539610372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-8f9670c2-b5c8-4609-8786-d98c3aa35d09 req-6bbfdefe-cd8e-4b87-8407-297b536e6177 tempest-TestStampPattern-539610372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-8f9670c2-b5c8-4609-8786-d98c3aa35d09 req-6bbfdefe-cd8e-4b87-8407-297b536e6177 tempest-TestStampPattern-539610372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-8f9670c2-b5c8-4609-8786-d98c3aa35d09 req-6bbfdefe-cd8e-4b87-8407-297b536e6177 tempest-TestStampPattern-539610372 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb', 'name': 'volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9bba5171-b978-43f9-895f-f4e8327388e6', 'enforce_multipath': True} {{(pid=87128) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:08:32 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-8f9670c2-b5c8-4609-8786-d98c3aa35d09 req-6bbfdefe-cd8e-4b87-8407-297b536e6177 tempest-TestStampPattern-539610372 None] attachment_update completed successfully. Sep 01 02:08:32 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Flow 'volume_create_manager' (99f63af3-3a6f-4ac4-a358-0c0947080836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6256a8f-c759-43f9-bc43-f9a0b8e40da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6256a8f-c759-43f9-bc43-f9a0b8e40da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1983097677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f669e1b-c2b0-464e-8f9b-faafd6640176,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='595efd53a81e48ac94b48cf90c593632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=dde6721e-4230-419f-a590-eaa86111d308,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:33Z,use_quota=True,user_id='25fe52acf92549549a687eb0dd4743cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c1dd38e-3bb3-475b-80e0-5a47a4e03854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c1dd38e-3bb3-475b-80e0-5a47a4e03854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (296f8dd2-0f61-44ae-af67-0ca1ffd6c73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (296f8dd2-0f61-44ae-af67-0ca1ffd6c73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1f669e1b-c2b0-464e-8f9b-faafd6640176', 'volume_name': 'volume-1f669e1b-c2b0-464e-8f9b-faafd6640176', 'volume_size': 1, 'source_volid': 'dde6721e-4230-419f-a590-eaa86111d308', 'source_volstatus': 'available'}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f883fbf-9272-4dc7-aa49-a5467c082748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f883fbf-9272-4dc7-aa49-a5467c082748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3301ce1-ec4c-4ff3-b2e3-89ba459c44af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:33 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Volume 1f669e1b-c2b0-464e-8f9b-faafd6640176: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1f669e1b-c2b0-464e-8f9b-faafd6640176', 'volume_size': 1, 'source_volid': 'dde6721e-4230-419f-a590-eaa86111d308', 'source_volstatus': 'available'} Sep 01 02:08:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:33 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Cloning volume dde6721e-4230-419f-a590-eaa86111d308 to volume 1f669e1b-c2b0-464e-8f9b-faafd6640176 Sep 01 02:08:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Creating offline snapshot 73e8d694-83a7-4636-846f-3f4c2b596be2 of volume dde6721e-4230-419f-a590-eaa86111d308 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:08:33 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dc6eba-9b4a-4824-b72e-2e1b01367089]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:33 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308 Sep 01 02:08:33 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:33 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308" returned: 0 in 0.580s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308.73e8d694-83a7-4636-846f-3f4c2b596be2 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:33 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308.73e8d694-83a7-4636-846f-3f4c2b596be2 1G Sep 01 02:08:33 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:34 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308.73e8d694-83a7-4636-846f-3f4c2b596be2 1G" returned: 0 in 0.563s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dde6721e-4230-419f-a590-eaa86111d308 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308.73e8d694-83a7-4636-846f-3f4c2b596be2 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:34 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dde6721e-4230-419f-a590-eaa86111d308 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308.73e8d694-83a7-4636-846f-3f4c2b596be2 Sep 01 02:08:34 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:34 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dde6721e-4230-419f-a590-eaa86111d308 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308.73e8d694-83a7-4636-846f-3f4c2b596be2" returned: 0 in 0.431s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:34 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308.73e8d694-83a7-4636-846f-3f4c2b596be2 is being set with open permissions: ugo+rw Sep 01 02:08:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308.73e8d694-83a7-4636-846f-3f4c2b596be2 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:34 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308.73e8d694-83a7-4636-846f-3f4c2b596be2 Sep 01 02:08:34 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:35 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308.73e8d694-83a7-4636-846f-3f4c2b596be2" returned: 0 in 0.495s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:35 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308.info Sep 01 02:08:35 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:35 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308.info" returned: 0 in 0.499s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:35 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308.info is being set with open permissions: ugo+rw Sep 01 02:08:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:35 devstack sudo[99737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308.info Sep 01 02:08:35 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:36 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308.info" returned: 0 in 0.377s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Acquiring lock "cinder-quobyte-1f669e1b-c2b0-464e-8f9b-faafd6640176" by "_copy_volume_from_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Lock "cinder-quobyte-1f669e1b-c2b0-464e-8f9b-faafd6640176" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:36 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] snapshot: 73e8d694-83a7-4636-846f-3f4c2b596be2, volume: 1f669e1b-c2b0-464e-8f9b-faafd6640176, {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:08:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:36 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:36 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:36 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[8793cd51-687c-44d8-bdac-ed4be2838d05]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308.73e8d694-83a7-4636-846f-3f4c2b596be2 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:36 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Flow 'volume_create_manager' (d425e611-459a-4e12-a46e-ad78b845a244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77cf4bb9-f4eb-4681-a86e-4f852d47d7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77cf4bb9-f4eb-4681-a86e-4f852d47d7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e8b84b4-0524-478e-b5f1-9fc95bfbefca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ddddd2b71dc4087810235be3b2d4e41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:36Z,use_quota=True,user_id='378ea3fb45f74f27b193c19251df9d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dae3bffd-b9ca-42d2-80ac-978bfad4f5b0),volume_type_id=dae3bffd-b9ca-42d2-80ac-978bfad4f5b0)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b4ae30a-616c-4847-afba-c456b9cc40e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b4ae30a-616c-4847-afba-c456b9cc40e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d92a08-816c-46ba-9e9c-a47de8f8364c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:36 devstack cinder-volume[87128]: DEBUG cinder.image.glance [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Creating Keystone auth plugin from conf {{(pid=87128) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:08:36 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308.73e8d694-83a7-4636-846f-3f4c2b596be2 Sep 01 02:08:36 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:36 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308.73e8d694-83a7-4636-846f-3f4c2b596be2" returned: 0 in 0.425s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:36 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dde6721e-4230-419f-a590-eaa86111d308(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:08:36 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc6f700-4722-4a2c-99cd-c02fed9b5242]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:36 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308 Sep 01 02:08:36 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d92a08-816c-46ba-9e9c-a47de8f8364c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7e8b84b4-0524-478e-b5f1-9fc95bfbefca', 'volume_name': 'volume-7e8b84b4-0524-478e-b5f1-9fc95bfbefca', 'volume_size': 1, 'image_id': '33255395-bd28-4639-ab11-adf809cd0175', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33255395-bd28-4639-ab11-adf809cd0175', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '96f877b53fa51275b7e853d4bb656807', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9ddddd2b71dc4087810235be3b2d4e41', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bb041c4023b9512c25ce3b79c8585f7ed38163a097be0f657b86dd76c35a2958c2142403a426ff2042c6f851b3dbdc9ae79d4ebf9455bb09b06299142af1da8b', 'id': '33255395-bd28-4639-ab11-adf809cd0175', 'created_at': datetime.datetime(2026, 9, 1, 0, 8, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 8, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33255395-bd28-4639-ab11-adf809cd0175/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baa1640d-ac57-4ab1-b5df-d51a32be8f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baa1640d-ac57-4ab1-b5df-d51a32be8f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c241d3a1-e169-43d3-8423-968c9ad79ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:36 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Volume 7e8b84b4-0524-478e-b5f1-9fc95bfbefca: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7e8b84b4-0524-478e-b5f1-9fc95bfbefca', 'volume_size': 1, 'image_id': '33255395-bd28-4639-ab11-adf809cd0175', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33255395-bd28-4639-ab11-adf809cd0175', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '96f877b53fa51275b7e853d4bb656807', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9ddddd2b71dc4087810235be3b2d4e41', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bb041c4023b9512c25ce3b79c8585f7ed38163a097be0f657b86dd76c35a2958c2142403a426ff2042c6f851b3dbdc9ae79d4ebf9455bb09b06299142af1da8b', 'id': '33255395-bd28-4639-ab11-adf809cd0175', 'created_at': datetime.datetime(2026, 9, 1, 0, 8, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 8, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33255395-bd28-4639-ab11-adf809cd0175/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 01 02:08:36 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Trying to clone 7e8b84b4-0524-478e-b5f1-9fc95bfbefca from image 33255395-bd28-4639-ab11-adf809cd0175 at location (None, [{'url': 'file:///opt/stack/data/glance/images/33255395-bd28-4639-ab11-adf809cd0175', 'metadata': {}}]). {{(pid=87128) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:08:37 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_33255395-bd28-4639-ab11-adf809cd0175_g_lt5blpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87128) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:08:37 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Image download 0.00 MB at 0.00 MB/s Sep 01 02:08:37 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fe4c51-dc66-4f88-96ef-9e3bb650cd01]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33255395-bd28-4639-ab11-adf809cd0175_g_lt5blpdevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:37 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308" returned: 0 in 0.428s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:37 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308 {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:08:37 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Creating direct copy from snapshot {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:08:37 devstack cinder-volume[87128]: DEBUG cinder.utils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Path /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1f669e1b-c2b0-464e-8f9b-faafd6640176 not found in is_blk_device check {{(pid=87128) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:08:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1f669e1b-c2b0-464e-8f9b-faafd6640176 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:37 devstack sudo[99756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1f669e1b-c2b0-464e-8f9b-faafd6640176 Sep 01 02:08:37 devstack sudo[99756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:37 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33255395-bd28-4639-ab11-adf809cd0175_g_lt5blpdevstack@QuobyteHD Sep 01 02:08:37 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:37 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33255395-bd28-4639-ab11-adf809cd0175_g_lt5blpdevstack@QuobyteHD" returned: 0 in 0.455s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33255395-bd28-4639-ab11-adf809cd0175_g_lt5blpdevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:37 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33255395-bd28-4639-ab11-adf809cd0175_g_lt5blpdevstack@QuobyteHD Sep 01 02:08:37 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:38 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33255395-bd28-4639-ab11-adf809cd0175_g_lt5blpdevstack@QuobyteHD" returned: 1 in 0.523s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33255395-bd28-4639-ab11-adf809cd0175_g_lt5blpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:08:38 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Temporary image 33255395-bd28-4639-ab11-adf809cd0175 is fetched for user 378ea3fb45f74f27b193c19251df9d8c. {{(pid=87128) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:08:38 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7fc3b0-9b76-46d1-8174-b021d2d2f6d7]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33255395-bd28-4639-ab11-adf809cd0175_g_lt5blpdevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:38 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33255395-bd28-4639-ab11-adf809cd0175_g_lt5blpdevstack@QuobyteHD Sep 01 02:08:38 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:39 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-bc390c21-62a6-4f48-8f51-3820fa01783c req-50a56ede-1737-4fe4-a46c-cd071f3266c2 tempest-TestStampPattern-539610372 None] Terminate volume connection completed successfully. Sep 01 02:08:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-bc390c21-62a6-4f48-8f51-3820fa01783c req-50a56ede-1737-4fe4-a46c-cd071f3266c2 tempest-TestStampPattern-539610372 None] Deleting attachment 9bba5171-b978-43f9-895f-f4e8327388e6. {{(pid=87128) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:08:39 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33255395-bd28-4639-ab11-adf809cd0175_g_lt5blpdevstack@QuobyteHD" returned: 0 in 1.217s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33255395-bd28-4639-ab11-adf809cd0175_g_lt5blpdevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:39 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33255395-bd28-4639-ab11-adf809cd0175_g_lt5blpdevstack@QuobyteHD Sep 01 02:08:39 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:40 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33255395-bd28-4639-ab11-adf809cd0175_g_lt5blpdevstack@QuobyteHD" returned: 1 in 0.801s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33255395-bd28-4639-ab11-adf809cd0175_g_lt5blpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:08:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-51d8a4e3-3d43-4130-b360-257fb4188cd0 tempest-TestStampPattern-539610372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:43 devstack sudo[99756]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1f669e1b-c2b0-464e-8f9b-faafd6640176" returned: 0 in 5.906s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:43 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308, size 1024.00 MB, duration 5.91 sec, destination /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1f669e1b-c2b0-464e-8f9b-faafd6640176 {{(pid=87128) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:08:43 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Converted 1024.00 MB image at 173.36 MB/s Sep 01 02:08:43 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1f669e1b-c2b0-464e-8f9b-faafd6640176 is being set with open permissions: ugo+rw Sep 01 02:08:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1f669e1b-c2b0-464e-8f9b-faafd6640176 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:43 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1f669e1b-c2b0-464e-8f9b-faafd6640176 Sep 01 02:08:43 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:43 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1f669e1b-c2b0-464e-8f9b-faafd6640176" returned: 0 in 0.263s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:43 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Lock "cinder-quobyte-1f669e1b-c2b0-464e-8f9b-faafd6640176" released by "_copy_volume_from_snapshot" :: held 7.101s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:43 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Acquiring lock "cinder-quobyte-73e8d694-83a7-4636-846f-3f4c2b596be2" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:43 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Lock "cinder-quobyte-73e8d694-83a7-4636-846f-3f4c2b596be2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:43 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Deleting offline snapshot 73e8d694-83a7-4636-846f-3f4c2b596be2 of volume dde6721e-4230-419f-a590-eaa86111d308 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:08:43 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] snapshot_file for this snap is: volume-dde6721e-4230-419f-a590-eaa86111d308.73e8d694-83a7-4636-846f-3f4c2b596be2 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:08:43 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f57bdf-385c-4d39-908b-45106f24ff53]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308.73e8d694-83a7-4636-846f-3f4c2b596be2 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:43 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308.73e8d694-83a7-4636-846f-3f4c2b596be2 Sep 01 02:08:43 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:43 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308.73e8d694-83a7-4636-846f-3f4c2b596be2" returned: 0 in 0.379s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:43 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dde6721e-4230-419f-a590-eaa86111d308(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:08:43 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[099810ee-59dd-4a91-aac0-00214f17b1fe]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:43 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308 Sep 01 02:08:43 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:44 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308" returned: 0 in 0.568s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308.73e8d694-83a7-4636-846f-3f4c2b596be2 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:44 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308.73e8d694-83a7-4636-846f-3f4c2b596be2 Sep 01 02:08:44 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:44 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308.73e8d694-83a7-4636-846f-3f4c2b596be2" returned: 0 in 0.340s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308.73e8d694-83a7-4636-846f-3f4c2b596be2 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:44 devstack sudo[99848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308.73e8d694-83a7-4636-846f-3f4c2b596be2 Sep 01 02:08:44 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:45 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308.73e8d694-83a7-4636-846f-3f4c2b596be2" returned: 0 in 0.321s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:45 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Lock "cinder-quobyte-73e8d694-83a7-4636-846f-3f4c2b596be2" released by "_delete_snapshot" :: held 1.744s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.068s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.796s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:45 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e8b84b4-0524-478e-b5f1-9fc95bfbefca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ddddd2b71dc4087810235be3b2d4e41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:36Z,use_quota=True,user_id='378ea3fb45f74f27b193c19251df9d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dae3bffd-b9ca-42d2-80ac-978bfad4f5b0),volume_type_id=dae3bffd-b9ca-42d2-80ac-978bfad4f5b0)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:45 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Creating volume 7e8b84b4-0524-478e-b5f1-9fc95bfbefca {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:45 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:45 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:45 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:45 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:08:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7e8b84b4-0524-478e-b5f1-9fc95bfbefca 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:45 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3301ce1-ec4c-4ff3-b2e3-89ba459c44af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f669e1b-c2b0-464e-8f9b-faafd6640176', 'volume_size': 1, 'source_volid': 'dde6721e-4230-419f-a590-eaa86111d308', 'source_volstatus': 'available'}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:45 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4e05c4-8eef-4512-9888-2406221dff1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:45 devstack sudo[99851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7e8b84b4-0524-478e-b5f1-9fc95bfbefca 1073741824 Sep 01 02:08:45 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:45 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Volume volume-1f669e1b-c2b0-464e-8f9b-faafd6640176 (1f669e1b-c2b0-464e-8f9b-faafd6640176): created successfully Sep 01 02:08:45 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4e05c4-8eef-4512-9888-2406221dff1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:45 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Flow 'volume_create_manager' (99f63af3-3a6f-4ac4-a358-0c0947080836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:45 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-f9bc05c4-c65e-4f4b-9b74-4584982b2008 tempest-VolumesGetTest-713710237 None] Created volume successfully. Sep 01 02:08:45 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7e8b84b4-0524-478e-b5f1-9fc95bfbefca 1073741824" returned: 0 in 0.475s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7e8b84b4-0524-478e-b5f1-9fc95bfbefca {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:45 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7e8b84b4-0524-478e-b5f1-9fc95bfbefca Sep 01 02:08:45 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:45 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7e8b84b4-0524-478e-b5f1-9fc95bfbefca" returned: 0 in 0.249s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:45 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-51d8a4e3-3d43-4130-b360-257fb4188cd0 tempest-TestStampPattern-539610372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.188s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-51d8a4e3-3d43-4130-b360-257fb4188cd0 tempest-TestStampPattern-539610372 None] Creating offline snapshot 0bba738f-5a6b-40ef-b6ba-00a5c4b1700f of volume eb7a50bd-eb42-44e5-85b6-86df7f66c511 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:08:46 devstack cinder-volume[87128]: DEBUG cinder.volume.volume_utils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Attempting download of 33255395-bd28-4639-ab11-adf809cd0175 ((None, [{'url': 'file:///opt/stack/data/glance/images/33255395-bd28-4639-ab11-adf809cd0175', 'metadata': {}}])) to volume 7e8b84b4-0524-478e-b5f1-9fc95bfbefca. {{(pid=87128) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:08:46 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ab515d-5f53-45de-9177-01e093db63c2]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51d8a4e3-3d43-4130-b360-257fb4188cd0 tempest-TestStampPattern-539610372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:46 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fa1270-f9de-4604-a12a-26561dcc0539]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33255395-bd28-4639-ab11-adf809cd0175_61_6trsj {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:46 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511 Sep 01 02:08:46 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:46 devstack sudo[99861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33255395-bd28-4639-ab11-adf809cd0175_61_6trsj Sep 01 02:08:46 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:46 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33255395-bd28-4639-ab11-adf809cd0175_61_6trsj" returned: 0 in 0.369s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33255395-bd28-4639-ab11-adf809cd0175_61_6trsj {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:46 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51d8a4e3-3d43-4130-b360-257fb4188cd0 tempest-TestStampPattern-539610372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511" returned: 0 in 0.455s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51d8a4e3-3d43-4130-b360-257fb4188cd0 tempest-TestStampPattern-539610372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511.0bba738f-5a6b-40ef-b6ba-00a5c4b1700f 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:46 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511.0bba738f-5a6b-40ef-b6ba-00a5c4b1700f 1G Sep 01 02:08:46 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:46 devstack sudo[99869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33255395-bd28-4639-ab11-adf809cd0175_61_6trsj Sep 01 02:08:46 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:46 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33255395-bd28-4639-ab11-adf809cd0175_61_6trsj" returned: 1 in 0.416s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33255395-bd28-4639-ab11-adf809cd0175_61_6trsj' failed. Not Retrying. {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:08:46 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[02524522-e789-4213-9524-3fd4112068b0]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33255395-bd28-4639-ab11-adf809cd0175_g_lt5blpdevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:47 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33255395-bd28-4639-ab11-adf809cd0175_g_lt5blpdevstack@QuobyteHD Sep 01 02:08:47 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:47 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51d8a4e3-3d43-4130-b360-257fb4188cd0 tempest-TestStampPattern-539610372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511.0bba738f-5a6b-40ef-b6ba-00a5c4b1700f 1G" returned: 0 in 0.687s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51d8a4e3-3d43-4130-b360-257fb4188cd0 tempest-TestStampPattern-539610372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511.0bba738f-5a6b-40ef-b6ba-00a5c4b1700f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:47 devstack sudo[99880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511.0bba738f-5a6b-40ef-b6ba-00a5c4b1700f Sep 01 02:08:47 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:47 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] Flow 'volume_create_manager' (a906515e-da3f-436b-8f4c-67a38862b890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d121e2b6-bda3-4a08-8765-314396125bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d121e2b6-bda3-4a08-8765-314396125bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2091694488',display_name='tempest-VolumesGetTest-Volume-2123059915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a53399-ec69-41c2-a7d9-6368b61cc409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='595efd53a81e48ac94b48cf90c593632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:47Z,use_quota=True,user_id='25fe52acf92549549a687eb0dd4743cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:47 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b302a7d-2edc-4ce2-a8d0-baf8aba93f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b302a7d-2edc-4ce2-a8d0-baf8aba93f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1108bfd0-b198-412f-a623-0dcf21d342b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1108bfd0-b198-412f-a623-0dcf21d342b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6a53399-ec69-41c2-a7d9-6368b61cc409', 'volume_name': 'volume-f6a53399-ec69-41c2-a7d9-6368b61cc409', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8971c4f8-ff00-492d-b8ea-372ba5f17d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8971c4f8-ff00-492d-b8ea-372ba5f17d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68596d3d-9a94-4cda-b9a3-893be907d1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:47 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] Volume f6a53399-ec69-41c2-a7d9-6368b61cc409: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6a53399-ec69-41c2-a7d9-6368b61cc409', 'volume_size': 1} Sep 01 02:08:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33255395-bd28-4639-ab11-adf809cd0175_g_lt5blpdevstack@QuobyteHD" returned: 0 in 0.476s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33255395-bd28-4639-ab11-adf809cd0175_g_lt5blpdevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:47 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33255395-bd28-4639-ab11-adf809cd0175_g_lt5blpdevstack@QuobyteHD Sep 01 02:08:47 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:47 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51d8a4e3-3d43-4130-b360-257fb4188cd0 tempest-TestStampPattern-539610372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511.0bba738f-5a6b-40ef-b6ba-00a5c4b1700f" returned: 0 in 0.366s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:47 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-51d8a4e3-3d43-4130-b360-257fb4188cd0 tempest-TestStampPattern-539610372 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511.0bba738f-5a6b-40ef-b6ba-00a5c4b1700f is being set with open permissions: ugo+rw Sep 01 02:08:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51d8a4e3-3d43-4130-b360-257fb4188cd0 tempest-TestStampPattern-539610372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511.0bba738f-5a6b-40ef-b6ba-00a5c4b1700f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:47 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511.0bba738f-5a6b-40ef-b6ba-00a5c4b1700f Sep 01 02:08:47 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:47 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33255395-bd28-4639-ab11-adf809cd0175_g_lt5blpdevstack@QuobyteHD" returned: 1 in 0.367s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33255395-bd28-4639-ab11-adf809cd0175_g_lt5blpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:08:47 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] 33255395-bd28-4639-ab11-adf809cd0175 was raw, converting to qcow2 {{(pid=87128) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:08:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_33255395-bd28-4639-ab11-adf809cd0175_g_lt5blpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7e8b84b4-0524-478e-b5f1-9fc95bfbefca {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:47 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_33255395-bd28-4639-ab11-adf809cd0175_g_lt5blpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7e8b84b4-0524-478e-b5f1-9fc95bfbefca Sep 01 02:08:47 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:47 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51d8a4e3-3d43-4130-b360-257fb4188cd0 tempest-TestStampPattern-539610372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511.0bba738f-5a6b-40ef-b6ba-00a5c4b1700f" returned: 0 in 0.287s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51d8a4e3-3d43-4130-b360-257fb4188cd0 tempest-TestStampPattern-539610372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:47 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511.info Sep 01 02:08:47 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:48 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51d8a4e3-3d43-4130-b360-257fb4188cd0 tempest-TestStampPattern-539610372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511.info" returned: 0 in 0.364s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:48 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-51d8a4e3-3d43-4130-b360-257fb4188cd0 tempest-TestStampPattern-539610372 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511.info is being set with open permissions: ugo+rw Sep 01 02:08:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51d8a4e3-3d43-4130-b360-257fb4188cd0 tempest-TestStampPattern-539610372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:48 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511.info Sep 01 02:08:48 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:48 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_33255395-bd28-4639-ab11-adf809cd0175_g_lt5blpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7e8b84b4-0524-478e-b5f1-9fc95bfbefca" returned: 0 in 0.608s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:48 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_33255395-bd28-4639-ab11-adf809cd0175_g_lt5blpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7e8b84b4-0524-478e-b5f1-9fc95bfbefca {{(pid=87128) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:08:48 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 02:08:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7e8b84b4-0524-478e-b5f1-9fc95bfbefca 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:48 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7e8b84b4-0524-478e-b5f1-9fc95bfbefca 1G Sep 01 02:08:48 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:48 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51d8a4e3-3d43-4130-b360-257fb4188cd0 tempest-TestStampPattern-539610372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511.info" returned: 0 in 0.279s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-51d8a4e3-3d43-4130-b360-257fb4188cd0 tempest-TestStampPattern-539610372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.552s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.197s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:48 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2091694488',display_name='tempest-VolumesGetTest-Volume-2123059915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a53399-ec69-41c2-a7d9-6368b61cc409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='595efd53a81e48ac94b48cf90c593632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:47Z,use_quota=True,user_id='25fe52acf92549549a687eb0dd4743cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:48 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] Creating volume f6a53399-ec69-41c2-a7d9-6368b61cc409 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:48 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:48 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:48 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:48 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:08:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f6a53399-ec69-41c2-a7d9-6368b61cc409 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:48 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f6a53399-ec69-41c2-a7d9-6368b61cc409 1073741824 Sep 01 02:08:48 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:48 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-51d8a4e3-3d43-4130-b360-257fb4188cd0 tempest-TestStampPattern-539610372 None] Create snapshot completed successfully Sep 01 02:08:48 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7e8b84b4-0524-478e-b5f1-9fc95bfbefca 1G" returned: 0 in 0.402s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:48 devstack cinder-volume[87128]: DEBUG cinder.volume.volume_utils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Downloaded image 33255395-bd28-4639-ab11-adf809cd0175 ((None, [{'url': 'file:///opt/stack/data/glance/images/33255395-bd28-4639-ab11-adf809cd0175', 'metadata': {}}])) to volume 7e8b84b4-0524-478e-b5f1-9fc95bfbefca successfully. {{(pid=87128) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:08:48 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Temporary image 33255395-bd28-4639-ab11-adf809cd0175 for user 378ea3fb45f74f27b193c19251df9d8c is deleted. {{(pid=87128) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:08:48 devstack cinder-volume[87128]: DEBUG cinder.volume.volume_utils [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Marking volume 7e8b84b4-0524-478e-b5f1-9fc95bfbefca as bootable. {{(pid=87128) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:08:48 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Copying metadata from image 33255395-bd28-4639-ab11-adf809cd0175 to 7e8b84b4-0524-478e-b5f1-9fc95bfbefca. {{(pid=87128) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:08:48 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Creating volume glance metadata for volume 7e8b84b4-0524-478e-b5f1-9fc95bfbefca backed by image 33255395-bd28-4639-ab11-adf809cd0175 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '33255395-bd28-4639-ab11-adf809cd0175', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '96f877b53fa51275b7e853d4bb656807', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87128) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:08:48 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c241d3a1-e169-43d3-8423-968c9ad79ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e8b84b4-0524-478e-b5f1-9fc95bfbefca', 'volume_size': 1, 'image_id': '33255395-bd28-4639-ab11-adf809cd0175', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33255395-bd28-4639-ab11-adf809cd0175', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '96f877b53fa51275b7e853d4bb656807', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9ddddd2b71dc4087810235be3b2d4e41', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bb041c4023b9512c25ce3b79c8585f7ed38163a097be0f657b86dd76c35a2958c2142403a426ff2042c6f851b3dbdc9ae79d4ebf9455bb09b06299142af1da8b', 'id': '33255395-bd28-4639-ab11-adf809cd0175', 'created_at': datetime.datetime(2026, 9, 1, 0, 8, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 8, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33255395-bd28-4639-ab11-adf809cd0175/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:48 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (057cdd44-e2cb-4ba9-bfb3-1d1530a9dc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:48 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Volume volume-7e8b84b4-0524-478e-b5f1-9fc95bfbefca (7e8b84b4-0524-478e-b5f1-9fc95bfbefca): created successfully Sep 01 02:08:48 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (057cdd44-e2cb-4ba9-bfb3-1d1530a9dc2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:48 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Flow 'volume_create_manager' (d425e611-459a-4e12-a46e-ad78b845a244) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:48 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-362a3635-bd83-45de-9f20-b97e3c6703d4 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Created volume successfully. Sep 01 02:08:49 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f6a53399-ec69-41c2-a7d9-6368b61cc409 1073741824" returned: 0 in 0.495s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f6a53399-ec69-41c2-a7d9-6368b61cc409 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:49 devstack sudo[99919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f6a53399-ec69-41c2-a7d9-6368b61cc409 Sep 01 02:08:49 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:49 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f6a53399-ec69-41c2-a7d9-6368b61cc409" returned: 0 in 0.260s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68596d3d-9a94-4cda-b9a3-893be907d1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6a53399-ec69-41c2-a7d9-6368b61cc409', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46c00f67-bcd2-4935-81c9-8856886c5def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:49 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] Volume volume-f6a53399-ec69-41c2-a7d9-6368b61cc409 (f6a53399-ec69-41c2-a7d9-6368b61cc409): created successfully Sep 01 02:08:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46c00f67-bcd2-4935-81c9-8856886c5def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] Flow 'volume_create_manager' (a906515e-da3f-436b-8f4c-67a38862b890) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:49 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-19b130c0-1891-4b4d-a6f2-f541ad17b2ab tempest-VolumesGetTest-713710237 None] Created volume successfully. Sep 01 02:08:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-78153db0-5bc2-4512-bb01-4f0b7cd96797 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Acquiring lock "cinder-7e8b84b4-0524-478e-b5f1-9fc95bfbefca-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-78153db0-5bc2-4512-bb01-4f0b7cd96797 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Lock "cinder-7e8b84b4-0524-478e-b5f1-9fc95bfbefca-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-78153db0-5bc2-4512-bb01-4f0b7cd96797 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Acquiring lock "cinder-quobyte-7e8b84b4-0524-478e-b5f1-9fc95bfbefca" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-78153db0-5bc2-4512-bb01-4f0b7cd96797 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Lock "cinder-quobyte-7e8b84b4-0524-478e-b5f1-9fc95bfbefca" acquired by "delete_volume" :: waited 0.019s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:50 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[7100585d-fed6-414f-a108-ce3a3daa1836]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-78153db0-5bc2-4512-bb01-4f0b7cd96797 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7e8b84b4-0524-478e-b5f1-9fc95bfbefca {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:50 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7e8b84b4-0524-478e-b5f1-9fc95bfbefca Sep 01 02:08:50 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:50 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-78153db0-5bc2-4512-bb01-4f0b7cd96797 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7e8b84b4-0524-478e-b5f1-9fc95bfbefca" returned: 0 in 0.446s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-78153db0-5bc2-4512-bb01-4f0b7cd96797 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7e8b84b4-0524-478e-b5f1-9fc95bfbefca {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:50 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7e8b84b4-0524-478e-b5f1-9fc95bfbefca Sep 01 02:08:50 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-677b154e-961e-4f85-958f-10d0b6740480 tempest-VolumesGetTest-713710237 None] Acquiring lock "cinder-f6a53399-ec69-41c2-a7d9-6368b61cc409-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-677b154e-961e-4f85-958f-10d0b6740480 tempest-VolumesGetTest-713710237 None] Lock "cinder-f6a53399-ec69-41c2-a7d9-6368b61cc409-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-677b154e-961e-4f85-958f-10d0b6740480 tempest-VolumesGetTest-713710237 None] Acquiring lock "cinder-quobyte-f6a53399-ec69-41c2-a7d9-6368b61cc409" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:50 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-78153db0-5bc2-4512-bb01-4f0b7cd96797 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7e8b84b4-0524-478e-b5f1-9fc95bfbefca" returned: 0 in 0.331s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-677b154e-961e-4f85-958f-10d0b6740480 tempest-VolumesGetTest-713710237 None] Lock "cinder-quobyte-f6a53399-ec69-41c2-a7d9-6368b61cc409" acquired by "delete_volume" :: waited 0.035s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-78153db0-5bc2-4512-bb01-4f0b7cd96797 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Lock "cinder-quobyte-7e8b84b4-0524-478e-b5f1-9fc95bfbefca" released by "delete_volume" :: held 0.855s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:50 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db0729c-0907-4bdd-814f-df96823db923]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-677b154e-961e-4f85-958f-10d0b6740480 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f6a53399-ec69-41c2-a7d9-6368b61cc409 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:50 devstack cinder-volume[87128]: WARNING cinder.quota [None req-78153db0-5bc2-4512-bb01-4f0b7cd96797 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:08:50 devstack cinder-volume[87128]: WARNING cinder.quota [None req-78153db0-5bc2-4512-bb01-4f0b7cd96797 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:08:50 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-78153db0-5bc2-4512-bb01-4f0b7cd96797 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Created reservations ['6b4c2931-e85b-489a-8543-0fa1a1b88c45', '8ae6f51a-0c31-4ff5-be25-8c32cb4e3ffb', '58960de5-a333-4b44-9842-9bf66a5f9524', '80c98ca7-717e-436f-81f7-e54d1514804b'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-78153db0-5bc2-4512-bb01-4f0b7cd96797 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-78153db0-5bc2-4512-bb01-4f0b7cd96797 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:51 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-78153db0-5bc2-4512-bb01-4f0b7cd96797 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:51 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-78153db0-5bc2-4512-bb01-4f0b7cd96797 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-78153db0-5bc2-4512-bb01-4f0b7cd96797 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-78153db0-5bc2-4512-bb01-4f0b7cd96797 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:51 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:08:51 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:51 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f6a53399-ec69-41c2-a7d9-6368b61cc409 Sep 01 02:08:51 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:51 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-78153db0-5bc2-4512-bb01-4f0b7cd96797 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.471s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:51 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-78153db0-5bc2-4512-bb01-4f0b7cd96797 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:51 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-78153db0-5bc2-4512-bb01-4f0b7cd96797 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Deleted volume successfully. Sep 01 02:08:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-78153db0-5bc2-4512-bb01-4f0b7cd96797 tempest-VolumeAndVolumeTypeFromImageTest-126479849 None] Lock "cinder-7e8b84b4-0524-478e-b5f1-9fc95bfbefca-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:51 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-677b154e-961e-4f85-958f-10d0b6740480 tempest-VolumesGetTest-713710237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f6a53399-ec69-41c2-a7d9-6368b61cc409" returned: 0 in 0.847s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-677b154e-961e-4f85-958f-10d0b6740480 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f6a53399-ec69-41c2-a7d9-6368b61cc409 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:51 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f6a53399-ec69-41c2-a7d9-6368b61cc409 Sep 01 02:08:51 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:52 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-677b154e-961e-4f85-958f-10d0b6740480 tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f6a53399-ec69-41c2-a7d9-6368b61cc409" returned: 0 in 0.391s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-677b154e-961e-4f85-958f-10d0b6740480 tempest-VolumesGetTest-713710237 None] Lock "cinder-quobyte-f6a53399-ec69-41c2-a7d9-6368b61cc409" released by "delete_volume" :: held 1.303s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:52 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-677b154e-961e-4f85-958f-10d0b6740480 tempest-VolumesGetTest-713710237 None] Created reservations ['9dcffcb1-a698-4642-9860-3755979a5d24', '6e3c9518-0629-4b92-bad6-0e7fbdcd74fd', 'a13a9b2e-77f2-46bb-8391-d039e57fcda1', '165e11a8-90cb-4c60-8acd-962ce6dc6d84'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-677b154e-961e-4f85-958f-10d0b6740480 tempest-VolumesGetTest-713710237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-677b154e-961e-4f85-958f-10d0b6740480 tempest-VolumesGetTest-713710237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:52 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-677b154e-961e-4f85-958f-10d0b6740480 tempest-VolumesGetTest-713710237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:52 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-677b154e-961e-4f85-958f-10d0b6740480 tempest-VolumesGetTest-713710237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-677b154e-961e-4f85-958f-10d0b6740480 tempest-VolumesGetTest-713710237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-677b154e-961e-4f85-958f-10d0b6740480 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:52 devstack sudo[99968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:08:52 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:52 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-677b154e-961e-4f85-958f-10d0b6740480 tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.350s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:52 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-677b154e-961e-4f85-958f-10d0b6740480 tempest-VolumesGetTest-713710237 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:52 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-677b154e-961e-4f85-958f-10d0b6740480 tempest-VolumesGetTest-713710237 None] Deleted volume successfully. Sep 01 02:08:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-677b154e-961e-4f85-958f-10d0b6740480 tempest-VolumesGetTest-713710237 None] Lock "cinder-f6a53399-ec69-41c2-a7d9-6368b61cc409-delete_volume" released by "delete_volume" :: held 1.962s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2792d66c-fc6d-45c5-9610-6ea293b33e92 tempest-VolumesGetTest-713710237 None] Acquiring lock "cinder-1f669e1b-c2b0-464e-8f9b-faafd6640176-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2792d66c-fc6d-45c5-9610-6ea293b33e92 tempest-VolumesGetTest-713710237 None] Lock "cinder-1f669e1b-c2b0-464e-8f9b-faafd6640176-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2792d66c-fc6d-45c5-9610-6ea293b33e92 tempest-VolumesGetTest-713710237 None] Acquiring lock "cinder-quobyte-1f669e1b-c2b0-464e-8f9b-faafd6640176" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2792d66c-fc6d-45c5-9610-6ea293b33e92 tempest-VolumesGetTest-713710237 None] Lock "cinder-quobyte-1f669e1b-c2b0-464e-8f9b-faafd6640176" acquired by "delete_volume" :: waited 0.028s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:53 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[530d79a2-ddee-46a6-af66-8e91da463ba2]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2792d66c-fc6d-45c5-9610-6ea293b33e92 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1f669e1b-c2b0-464e-8f9b-faafd6640176 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:53 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1f669e1b-c2b0-464e-8f9b-faafd6640176 Sep 01 02:08:53 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:53 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2792d66c-fc6d-45c5-9610-6ea293b33e92 tempest-VolumesGetTest-713710237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1f669e1b-c2b0-464e-8f9b-faafd6640176" returned: 0 in 0.550s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2792d66c-fc6d-45c5-9610-6ea293b33e92 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1f669e1b-c2b0-464e-8f9b-faafd6640176 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:53 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1f669e1b-c2b0-464e-8f9b-faafd6640176 Sep 01 02:08:53 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:54 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2792d66c-fc6d-45c5-9610-6ea293b33e92 tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1f669e1b-c2b0-464e-8f9b-faafd6640176" returned: 0 in 0.330s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:54 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2792d66c-fc6d-45c5-9610-6ea293b33e92 tempest-VolumesGetTest-713710237 None] Lock "cinder-quobyte-1f669e1b-c2b0-464e-8f9b-faafd6640176" released by "delete_volume" :: held 0.932s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:54 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-2792d66c-fc6d-45c5-9610-6ea293b33e92 tempest-VolumesGetTest-713710237 None] Created reservations ['9565c3e2-41aa-4b1f-95d4-7e5139d233a1', '8f76b312-f028-4b25-8245-0a170ee5ea97', '022c3a21-90cf-4a72-bd24-e33caa749361', '6f41895d-4719-45be-a9a8-d5c229eadfff'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2792d66c-fc6d-45c5-9610-6ea293b33e92 tempest-VolumesGetTest-713710237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2792d66c-fc6d-45c5-9610-6ea293b33e92 tempest-VolumesGetTest-713710237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2792d66c-fc6d-45c5-9610-6ea293b33e92 tempest-VolumesGetTest-713710237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2792d66c-fc6d-45c5-9610-6ea293b33e92 tempest-VolumesGetTest-713710237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2792d66c-fc6d-45c5-9610-6ea293b33e92 tempest-VolumesGetTest-713710237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2792d66c-fc6d-45c5-9610-6ea293b33e92 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:54 devstack sudo[99987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:08:54 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:54 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2792d66c-fc6d-45c5-9610-6ea293b33e92 tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.287s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:54 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-2792d66c-fc6d-45c5-9610-6ea293b33e92 tempest-VolumesGetTest-713710237 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:54 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-2792d66c-fc6d-45c5-9610-6ea293b33e92 tempest-VolumesGetTest-713710237 None] Deleted volume successfully. Sep 01 02:08:54 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2792d66c-fc6d-45c5-9610-6ea293b33e92 tempest-VolumesGetTest-713710237 None] Lock "cinder-1f669e1b-c2b0-464e-8f9b-faafd6640176-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:55 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-df7f8167-f638-4dcc-8748-9a61c9e6150f tempest-VolumesGetTest-713710237 None] Acquiring lock "cinder-dde6721e-4230-419f-a590-eaa86111d308-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:55 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-df7f8167-f638-4dcc-8748-9a61c9e6150f tempest-VolumesGetTest-713710237 None] Lock "cinder-dde6721e-4230-419f-a590-eaa86111d308-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:55 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-df7f8167-f638-4dcc-8748-9a61c9e6150f tempest-VolumesGetTest-713710237 None] Acquiring lock "cinder-quobyte-dde6721e-4230-419f-a590-eaa86111d308" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:55 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-df7f8167-f638-4dcc-8748-9a61c9e6150f tempest-VolumesGetTest-713710237 None] Lock "cinder-quobyte-dde6721e-4230-419f-a590-eaa86111d308" acquired by "delete_volume" :: waited 0.036s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:55 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[35af469c-f801-4cd3-9a30-2275bfad90a1]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-df7f8167-f638-4dcc-8748-9a61c9e6150f tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:55 devstack sudo[99991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308 Sep 01 02:08:55 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:56 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-df7f8167-f638-4dcc-8748-9a61c9e6150f tempest-VolumesGetTest-713710237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308" returned: 0 in 0.613s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-df7f8167-f638-4dcc-8748-9a61c9e6150f tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:56 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308 Sep 01 02:08:56 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:56 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-df7f8167-f638-4dcc-8748-9a61c9e6150f tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dde6721e-4230-419f-a590-eaa86111d308" returned: 0 in 0.387s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:56 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-df7f8167-f638-4dcc-8748-9a61c9e6150f tempest-VolumesGetTest-713710237 None] Lock "cinder-quobyte-dde6721e-4230-419f-a590-eaa86111d308" released by "delete_volume" :: held 1.123s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:57 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-df7f8167-f638-4dcc-8748-9a61c9e6150f tempest-VolumesGetTest-713710237 None] Created reservations ['1c1dcbfd-f22a-4d09-8f07-b383d0957875', 'abf60bcc-34b3-425c-8a3a-749ee6689c30', '86bcab89-3c00-4a93-a62c-b933769fbf0c', '348e6f11-012c-4fec-9e15-f1096e19698b'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-df7f8167-f638-4dcc-8748-9a61c9e6150f tempest-VolumesGetTest-713710237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-df7f8167-f638-4dcc-8748-9a61c9e6150f tempest-VolumesGetTest-713710237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-df7f8167-f638-4dcc-8748-9a61c9e6150f tempest-VolumesGetTest-713710237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-df7f8167-f638-4dcc-8748-9a61c9e6150f tempest-VolumesGetTest-713710237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-df7f8167-f638-4dcc-8748-9a61c9e6150f tempest-VolumesGetTest-713710237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-df7f8167-f638-4dcc-8748-9a61c9e6150f tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:57 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:08:57 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:57 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-df7f8167-f638-4dcc-8748-9a61c9e6150f tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.270s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:57 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-df7f8167-f638-4dcc-8748-9a61c9e6150f tempest-VolumesGetTest-713710237 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:57 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-df7f8167-f638-4dcc-8748-9a61c9e6150f tempest-VolumesGetTest-713710237 None] Deleted volume successfully. Sep 01 02:08:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-df7f8167-f638-4dcc-8748-9a61c9e6150f tempest-VolumesGetTest-713710237 None] Lock "cinder-dde6721e-4230-419f-a590-eaa86111d308-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Flow 'volume_create_manager' (30357f0b-7d74-4331-8b07-c7dfb2a140b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f8bf74-b699-4705-b108-8b5b9e54387a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f8bf74-b699-4705-b108-8b5b9e54387a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-361394481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16a59495-5172-481e-9bb2-facfac4c167f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb8a7e226c96401e8347e4b5cf9986d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:58Z,use_quota=True,user_id='77e1278ef6f242ed8bc6090f49de726a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06fe9bb3-330e-4166-a59c-427d3ec1a922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06fe9bb3-330e-4166-a59c-427d3ec1a922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e228e3e-e0c6-4f48-870b-6ca1ab69317c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e228e3e-e0c6-4f48-870b-6ca1ab69317c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16a59495-5172-481e-9bb2-facfac4c167f', 'volume_name': 'volume-16a59495-5172-481e-9bb2-facfac4c167f', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dce12e5-57d9-482c-a83d-6267c91487fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dce12e5-57d9-482c-a83d-6267c91487fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e6de36-4f40-42ff-a5a5-08b0407b2750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:58 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Volume 16a59495-5172-481e-9bb2-facfac4c167f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16a59495-5172-481e-9bb2-facfac4c167f', 'volume_size': 1} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-361394481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16a59495-5172-481e-9bb2-facfac4c167f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb8a7e226c96401e8347e4b5cf9986d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:58Z,use_quota=True,user_id='77e1278ef6f242ed8bc6090f49de726a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Creating volume 16a59495-5172-481e-9bb2-facfac4c167f {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:58 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-16a59495-5172-481e-9bb2-facfac4c167f 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:58 devstack sudo[100019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-16a59495-5172-481e-9bb2-facfac4c167f 1073741824 Sep 01 02:08:58 devstack sudo[100019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Flow 'volume_create_manager' (c47a1d6f-fd6a-4f82-9846-519a049c50f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a479d2-71a0-4a65-8448-6e1cbf139586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a479d2-71a0-4a65-8448-6e1cbf139586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1235182275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8679077-2240-4ab4-9483-8cd01741e672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1489e85ed73e4b63bfe10d24dc012399',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0bba738f-5a6b-40ef-b6ba-00a5c4b1700f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:59Z,use_quota=True,user_id='a4a59457f03545638dd39db76b13fa66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2a0dbb-8c2f-4e1e-a5cd-fb6f449e5535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2a0dbb-8c2f-4e1e-a5cd-fb6f449e5535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aac2ea0-6eb6-475e-832f-955b0fc2a093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aac2ea0-6eb6-475e-832f-955b0fc2a093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c8679077-2240-4ab4-9483-8cd01741e672', 'volume_name': 'volume-c8679077-2240-4ab4-9483-8cd01741e672', 'volume_size': 1, 'snapshot_id': '0bba738f-5a6b-40ef-b6ba-00a5c4b1700f'}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (573abd58-c920-4b4d-92b1-605a8d3f64e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (573abd58-c920-4b4d-92b1-605a8d3f64e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13abc8cb-9281-48a3-9e26-4b26c753afa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:58 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Volume c8679077-2240-4ab4-9483-8cd01741e672: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c8679077-2240-4ab4-9483-8cd01741e672', 'volume_size': 1, 'snapshot_id': '0bba738f-5a6b-40ef-b6ba-00a5c4b1700f'} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:58 devstack sudo[100019]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-16a59495-5172-481e-9bb2-facfac4c167f 1073741824" returned: 0 in 0.597s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-16a59495-5172-481e-9bb2-facfac4c167f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:58 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-16a59495-5172-481e-9bb2-facfac4c167f Sep 01 02:08:58 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Flow 'volume_create_manager' (c0a7f9f4-4090-4e0a-84d9-d857880d126d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53da41a6-7585-43c5-9603-378027833580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53da41a6-7585-43c5-9603-378027833580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-747989227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a9cb6f9-b98d-486b-b828-f15d6802d9b0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='595efd53a81e48ac94b48cf90c593632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:59Z,use_quota=True,user_id='25fe52acf92549549a687eb0dd4743cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:59 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c710624f-9588-44a1-aee3-9fdf5409c7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c710624f-9588-44a1-aee3-9fdf5409c7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5787302e-ebcb-4dac-a4a7-9ca1d0b24202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG cinder.image.glance [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Creating Keystone auth plugin from conf {{(pid=87128) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-16a59495-5172-481e-9bb2-facfac4c167f" returned: 0 in 0.403s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.533s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Acquiring lock "cinder-quobyte-0bba738f-5a6b-40ef-b6ba-00a5c4b1700f-c8679077-2240-4ab4-9483-8cd01741e672" by "_create_volume_from_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e6de36-4f40-42ff-a5a5-08b0407b2750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16a59495-5172-481e-9bb2-facfac4c167f', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e517d4a-1511-44df-832c-8b9483902f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Lock "cinder-quobyte-0bba738f-5a6b-40ef-b6ba-00a5c4b1700f-c8679077-2240-4ab4-9483-8cd01741e672" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Creating volume c8679077-2240-4ab4-9483-8cd01741e672 from snapshot 0bba738f-5a6b-40ef-b6ba-00a5c4b1700f {{(pid=87128) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Acquiring lock "cinder-quobyte-c8679077-2240-4ab4-9483-8cd01741e672" by "_copy_volume_from_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:59 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Volume volume-16a59495-5172-481e-9bb2-facfac4c167f (16a59495-5172-481e-9bb2-facfac4c167f): created successfully Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e517d4a-1511-44df-832c-8b9483902f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Flow 'volume_create_manager' (30357f0b-7d74-4331-8b07-c7dfb2a140b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Lock "cinder-quobyte-c8679077-2240-4ab4-9483-8cd01741e672" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] snapshot: 0bba738f-5a6b-40ef-b6ba-00a5c4b1700f, volume: c8679077-2240-4ab4-9483-8cd01741e672, {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:08:59 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-8f15e854-a41f-4a83-8d9d-129f9c870d55 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Created volume successfully. Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f175f20-b856-40c1-a63a-5161cab766ea]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511.0bba738f-5a6b-40ef-b6ba-00a5c4b1700f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:59 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511.0bba738f-5a6b-40ef-b6ba-00a5c4b1700f Sep 01 02:08:59 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5787302e-ebcb-4dac-a4a7-9ca1d0b24202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7a9cb6f9-b98d-486b-b828-f15d6802d9b0', 'volume_name': 'volume-7a9cb6f9-b98d-486b-b828-f15d6802d9b0', 'volume_size': 1, 'image_id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64fc298b-4656-41e6-a52e-bd149cb491e9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0dbd8f0a33a74d5db3271102e89b70d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'created_at': datetime.datetime(2026, 8, 31, 23, 51, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 51, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64fc298b-4656-41e6-a52e-bd149cb491e9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e8511a-5664-464e-9a81-dcde366c2a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e8511a-5664-464e-9a81-dcde366c2a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0887cc54-eafc-4b9c-8ea4-c696dcb8b59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:59 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Volume 7a9cb6f9-b98d-486b-b828-f15d6802d9b0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7a9cb6f9-b98d-486b-b828-f15d6802d9b0', 'volume_size': 1, 'image_id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64fc298b-4656-41e6-a52e-bd149cb491e9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0dbd8f0a33a74d5db3271102e89b70d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'created_at': datetime.datetime(2026, 8, 31, 23, 51, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 51, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64fc298b-4656-41e6-a52e-bd149cb491e9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 02:08:59 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Trying to clone 7a9cb6f9-b98d-486b-b828-f15d6802d9b0 from image 64fc298b-4656-41e6-a52e-bd149cb491e9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/64fc298b-4656-41e6-a52e-bd149cb491e9', 'metadata': {}}]). {{(pid=87128) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:09:00 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511.0bba738f-5a6b-40ef-b6ba-00a5c4b1700f" returned: 0 in 0.774s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:00 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:09:00 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[473ba2d0-b5e2-45e4-a642-6afe035c58a5]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:00 devstack sudo[100072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511 Sep 01 02:09:00 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:00 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_fvrykywzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87128) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:09:00 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Image download 20.69 MB at 20.69 MB/s Sep 01 02:09:00 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ce378f-201a-43c0-80c2-bea6f908e722]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_fvrykywzdevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:00 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511" returned: 0 in 0.694s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:00 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511 {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:09:00 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Creating direct copy from snapshot {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:09:00 devstack cinder-volume[87128]: DEBUG cinder.utils [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Path /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c8679077-2240-4ab4-9483-8cd01741e672 not found in is_blk_device check {{(pid=87128) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:09:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c8679077-2240-4ab4-9483-8cd01741e672 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:00 devstack sudo[100098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c8679077-2240-4ab4-9483-8cd01741e672 Sep 01 02:09:00 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:01 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_fvrykywzdevstack@QuobyteHD Sep 01 02:09:01 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:01 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_fvrykywzdevstack@QuobyteHD" returned: 0 in 0.754s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:01 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Temporary image 64fc298b-4656-41e6-a52e-bd149cb491e9 is fetched for user 25fe52acf92549549a687eb0dd4743cf. {{(pid=87128) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:09:01 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f6e408-fbab-46a0-8d83-9021fd72534c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_fvrykywzdevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:01 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Flow 'volume_create_manager' (6d62daa4-5877-4453-b41b-5b5a93c4d532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21dc2f8d-319f-4544-a8bc-fc27a9b53c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21dc2f8d-319f-4544-a8bc-fc27a9b53c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-791365161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e75714-6e31-4d33-a3ba-c56a4c3e7af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb8a7e226c96401e8347e4b5cf9986d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:02Z,use_quota=True,user_id='77e1278ef6f242ed8bc6090f49de726a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d8d2c6-9f8d-4601-a293-cb1cfba1c472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d8d2c6-9f8d-4601-a293-cb1cfba1c472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33734e1b-291b-4619-8482-7454997fb1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33734e1b-291b-4619-8482-7454997fb1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0e75714-6e31-4d33-a3ba-c56a4c3e7af0', 'volume_name': 'volume-a0e75714-6e31-4d33-a3ba-c56a4c3e7af0', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18316a8-7519-4412-81ba-4413059eaa4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18316a8-7519-4412-81ba-4413059eaa4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd45bdad-68bd-4d27-83ec-0be51c6a3603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:02 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Volume a0e75714-6e31-4d33-a3ba-c56a4c3e7af0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0e75714-6e31-4d33-a3ba-c56a4c3e7af0', 'volume_size': 1} Sep 01 02:09:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:02 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_fvrykywzdevstack@QuobyteHD Sep 01 02:09:02 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:03 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_fvrykywzdevstack@QuobyteHD" returned: 0 in 1.127s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:04 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Flow 'volume_create_manager' (1e295d42-8913-46f9-8e7c-1d2b9eeea189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7ade045-683e-4363-aa75-45513e8eb7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7ade045-683e-4363-aa75-45513e8eb7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-121165039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3583a0-0454-4d29-97b3-2ad1257fbe4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb8a7e226c96401e8347e4b5cf9986d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:04Z,use_quota=True,user_id='77e1278ef6f242ed8bc6090f49de726a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f44c06b-015c-49a8-bfc8-27f2258a65b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f44c06b-015c-49a8-bfc8-27f2258a65b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (496b0d00-add5-4617-8f82-f9e6917a9cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (496b0d00-add5-4617-8f82-f9e6917a9cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba3583a0-0454-4d29-97b3-2ad1257fbe4c', 'volume_name': 'volume-ba3583a0-0454-4d29-97b3-2ad1257fbe4c', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf39f22-2588-4aa1-b065-07f44be7da4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf39f22-2588-4aa1-b065-07f44be7da4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31fe1589-1f8d-4939-8d4f-9808d2e5eae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:04 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Volume ba3583a0-0454-4d29-97b3-2ad1257fbe4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba3583a0-0454-4d29-97b3-2ad1257fbe4c', 'volume_size': 1} Sep 01 02:09:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:04 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=95,cinder:DELETE=4,cinder:UPDATE=104,cinder:INSERT=31 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:09:04 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Flow 'volume_create_manager' (8415f908-f322-47da-bd46-0a9d71eeefc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e527b80c-25cb-45da-8537-4e8fa829a7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e527b80c-25cb-45da-8537-4e8fa829a7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1794620221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00ed28bf-5a19-461c-9987-3c53a1924a70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb8a7e226c96401e8347e4b5cf9986d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:05Z,use_quota=True,user_id='77e1278ef6f242ed8bc6090f49de726a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b79e75ba-1b2a-4f52-a8c4-ecfd797b2420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b79e75ba-1b2a-4f52-a8c4-ecfd797b2420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b508464-345d-4cf0-91f6-c6d99833374d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b508464-345d-4cf0-91f6-c6d99833374d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00ed28bf-5a19-461c-9987-3c53a1924a70', 'volume_name': 'volume-00ed28bf-5a19-461c-9987-3c53a1924a70', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93cee634-4ad7-4927-bce2-792403ceb6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93cee634-4ad7-4927-bce2-792403ceb6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d948efa-8689-4ab1-9378-345f655230d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:05 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Volume 00ed28bf-5a19-461c-9987-3c53a1924a70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00ed28bf-5a19-461c-9987-3c53a1924a70', 'volume_size': 1} Sep 01 02:09:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:06 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Flow 'volume_create_manager' (49861ec1-095a-4442-b6c3-369961f4a3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53324f53-5225-4deb-b5fc-7df78bf06d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53324f53-5225-4deb-b5fc-7df78bf06d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-619133929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bbf2fa1-6df8-4a9c-a0d7-71389a92187b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb8a7e226c96401e8347e4b5cf9986d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:06Z,use_quota=True,user_id='77e1278ef6f242ed8bc6090f49de726a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52438a4d-1f2d-4a53-852e-24291d3d4812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52438a4d-1f2d-4a53-852e-24291d3d4812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffaab119-3d58-4df2-81b7-3663e80c5d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffaab119-3d58-4df2-81b7-3663e80c5d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bbf2fa1-6df8-4a9c-a0d7-71389a92187b', 'volume_name': 'volume-7bbf2fa1-6df8-4a9c-a0d7-71389a92187b', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f6a8b4-898d-4a08-8a77-aaf8184fc193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f6a8b4-898d-4a08-8a77-aaf8184fc193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a8e6c9-f611-4b3b-8ce6-d8594393bb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:07 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Volume 7bbf2fa1-6df8-4a9c-a0d7-71389a92187b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bbf2fa1-6df8-4a9c-a0d7-71389a92187b', 'volume_size': 1} Sep 01 02:09:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:09 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] Flow 'volume_create_manager' (457458d7-9f5c-4b9a-8fb3-5c882fe76784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17716fba-9e9b-4794-b32d-8bab3ba4fc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17716fba-9e9b-4794-b32d-8bab3ba4fc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2030675998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6add184a-a2c1-422f-aa1c-7eb3c1cbbd44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c9ee8aeebe4d74a77387ece6d1c22c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:09Z,use_quota=True,user_id='5f659abcc96c4f38a25e8d7f21f3f1eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb27ee96-7919-424d-bcc6-f1586931dffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb27ee96-7919-424d-bcc6-f1586931dffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95172c51-43e0-4086-ac5a-88d796426862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95172c51-43e0-4086-ac5a-88d796426862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6add184a-a2c1-422f-aa1c-7eb3c1cbbd44', 'volume_name': 'volume-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e283c95c-d716-43cc-a4e4-ac5d5678fd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e283c95c-d716-43cc-a4e4-ac5d5678fd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6be3943-9296-4a68-9833-5899656e9f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:09 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] Volume 6add184a-a2c1-422f-aa1c-7eb3c1cbbd44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44', 'volume_size': 1} Sep 01 02:09:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:09 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Flow 'volume_create_manager' (bdac38ea-e2dd-46d1-95ba-339e16790969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (600f928d-2745-43cb-ae7b-e940daa05ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:10 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (600f928d-2745-43cb-ae7b-e940daa05ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-925700124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07a0c8e5-ddbd-4972-8655-c0ec968d6965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb8a7e226c96401e8347e4b5cf9986d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:09Z,use_quota=True,user_id='77e1278ef6f242ed8bc6090f49de726a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:10 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c49ced-633f-42fa-a7c4-e972ec040be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:10 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c49ced-633f-42fa-a7c4-e972ec040be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:10 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2236d581-fe4e-4a7b-8aff-551dc8984ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:10 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2236d581-fe4e-4a7b-8aff-551dc8984ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07a0c8e5-ddbd-4972-8655-c0ec968d6965', 'volume_name': 'volume-07a0c8e5-ddbd-4972-8655-c0ec968d6965', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:10 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8268cf01-a86c-442b-a029-32f3236f2542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:10 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8268cf01-a86c-442b-a029-32f3236f2542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:10 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (811c71f9-769b-4201-93b7-2da226b6fdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:10 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Volume 07a0c8e5-ddbd-4972-8655-c0ec968d6965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07a0c8e5-ddbd-4972-8655-c0ec968d6965', 'volume_size': 1} Sep 01 02:09:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:10 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c8679077-2240-4ab4-9483-8cd01741e672" returned: 0 in 9.355s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:10 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511, size 1024.00 MB, duration 9.36 sec, destination /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c8679077-2240-4ab4-9483-8cd01741e672 {{(pid=87128) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:09:10 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Converted 1024.00 MB image at 109.44 MB/s Sep 01 02:09:10 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c8679077-2240-4ab4-9483-8cd01741e672 is being set with open permissions: ugo+rw Sep 01 02:09:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c8679077-2240-4ab4-9483-8cd01741e672 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:10 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c8679077-2240-4ab4-9483-8cd01741e672 Sep 01 02:09:10 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:10 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c8679077-2240-4ab4-9483-8cd01741e672" returned: 0 in 0.342s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:10 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Lock "cinder-quobyte-c8679077-2240-4ab4-9483-8cd01741e672" released by "_copy_volume_from_snapshot" :: held 11.319s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:10 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Lock "cinder-quobyte-0bba738f-5a6b-40ef-b6ba-00a5c4b1700f-c8679077-2240-4ab4-9483-8cd01741e672" released by "_create_volume_from_snapshot" :: held 11.423s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.471s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.607s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:10 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-791365161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e75714-6e31-4d33-a3ba-c56a4c3e7af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb8a7e226c96401e8347e4b5cf9986d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:02Z,use_quota=True,user_id='77e1278ef6f242ed8bc6090f49de726a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:10 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Creating volume a0e75714-6e31-4d33-a3ba-c56a4c3e7af0 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:10 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:10 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:10 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:10 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:09:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a0e75714-6e31-4d33-a3ba-c56a4c3e7af0 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:10 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a0e75714-6e31-4d33-a3ba-c56a4c3e7af0 1073741824 Sep 01 02:09:10 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:10 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13abc8cb-9281-48a3-9e26-4b26c753afa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8679077-2240-4ab4-9483-8cd01741e672', 'volume_size': 1, 'snapshot_id': '0bba738f-5a6b-40ef-b6ba-00a5c4b1700f'}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:10 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (252b3140-ab90-450b-aaec-a24acef86cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:10 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Volume volume-c8679077-2240-4ab4-9483-8cd01741e672 (c8679077-2240-4ab4-9483-8cd01741e672): created successfully Sep 01 02:09:10 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (252b3140-ab90-450b-aaec-a24acef86cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:10 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Flow 'volume_create_manager' (c47a1d6f-fd6a-4f82-9846-519a049c50f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:10 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-fdc887f8-d31c-4fee-b1d4-bf26da5bd2ee tempest-TestStampPattern-539610372 None] Created volume successfully. Sep 01 02:09:11 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a0e75714-6e31-4d33-a3ba-c56a4c3e7af0 1073741824" returned: 0 in 0.690s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a0e75714-6e31-4d33-a3ba-c56a4c3e7af0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:11 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a0e75714-6e31-4d33-a3ba-c56a4c3e7af0 Sep 01 02:09:11 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:11 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a0e75714-6e31-4d33-a3ba-c56a4c3e7af0" returned: 0 in 0.336s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:11 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.796s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:11 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-747989227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a9cb6f9-b98d-486b-b828-f15d6802d9b0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='595efd53a81e48ac94b48cf90c593632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:59Z,use_quota=True,user_id='25fe52acf92549549a687eb0dd4743cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:11 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Creating volume 7a9cb6f9-b98d-486b-b828-f15d6802d9b0 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:11 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:11 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:11 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:11 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:09:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7a9cb6f9-b98d-486b-b828-f15d6802d9b0 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd45bdad-68bd-4d27-83ec-0be51c6a3603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0e75714-6e31-4d33-a3ba-c56a4c3e7af0', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:11 devstack sudo[100178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7a9cb6f9-b98d-486b-b828-f15d6802d9b0 1073741824 Sep 01 02:09:11 devstack sudo[100178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (583b2731-d57d-42d5-9e89-789aa5c25de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:11 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Volume volume-a0e75714-6e31-4d33-a3ba-c56a4c3e7af0 (a0e75714-6e31-4d33-a3ba-c56a4c3e7af0): created successfully Sep 01 02:09:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (583b2731-d57d-42d5-9e89-789aa5c25de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:11 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Flow 'volume_create_manager' (6d62daa4-5877-4453-b41b-5b5a93c4d532) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:11 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-8807ece2-d4f4-4ba0-81cb-8a741407eac5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Created volume successfully. Sep 01 02:09:12 devstack sudo[100178]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7a9cb6f9-b98d-486b-b828-f15d6802d9b0 1073741824" returned: 0 in 0.675s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7a9cb6f9-b98d-486b-b828-f15d6802d9b0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:12 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7a9cb6f9-b98d-486b-b828-f15d6802d9b0 Sep 01 02:09:12 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:13 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7a9cb6f9-b98d-486b-b828-f15d6802d9b0" returned: 0 in 0.540s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:13 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.771s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:13 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-121165039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3583a0-0454-4d29-97b3-2ad1257fbe4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb8a7e226c96401e8347e4b5cf9986d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:04Z,use_quota=True,user_id='77e1278ef6f242ed8bc6090f49de726a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:13 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Creating volume ba3583a0-0454-4d29-97b3-2ad1257fbe4c {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:13 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:13 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:13 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:13 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:09:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ba3583a0-0454-4d29-97b3-2ad1257fbe4c 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:13 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ba3583a0-0454-4d29-97b3-2ad1257fbe4c 1073741824 Sep 01 02:09:13 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:13 devstack cinder-volume[87128]: DEBUG cinder.volume.volume_utils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Attempting download of 64fc298b-4656-41e6-a52e-bd149cb491e9 ((None, [{'url': 'file:///opt/stack/data/glance/images/64fc298b-4656-41e6-a52e-bd149cb491e9', 'metadata': {}}])) to volume 7a9cb6f9-b98d-486b-b828-f15d6802d9b0. {{(pid=87128) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:09:13 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc926a6-995d-4d94-b8a2-1c153f74ef0d]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_7tw_03ea {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:13 devstack sudo[100232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_7tw_03ea Sep 01 02:09:13 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:14 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_7tw_03ea" returned: 0 in 0.679s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_7tw_03ea {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:14 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ba3583a0-0454-4d29-97b3-2ad1257fbe4c 1073741824" returned: 0 in 1.005s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:14 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_7tw_03ea Sep 01 02:09:14 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ba3583a0-0454-4d29-97b3-2ad1257fbe4c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:14 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ba3583a0-0454-4d29-97b3-2ad1257fbe4c Sep 01 02:09:14 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:14 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:14 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ba3583a0-0454-4d29-97b3-2ad1257fbe4c" returned: 0 in 0.407s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_7tw_03ea" returned: 1 in 0.632s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64fc298b-4656-41e6-a52e-bd149cb491e9_7tw_03ea' failed. Not Retrying. {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:09:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.585s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1794620221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00ed28bf-5a19-461c-9987-3c53a1924a70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb8a7e226c96401e8347e4b5cf9986d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:05Z,use_quota=True,user_id='77e1278ef6f242ed8bc6090f49de726a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Creating volume 00ed28bf-5a19-461c-9987-3c53a1924a70 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:14 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:09:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-00ed28bf-5a19-461c-9987-3c53a1924a70 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:14 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ca4ad7-97f3-4e28-a84a-63b71518e72f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_fvrykywzdevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:14 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-00ed28bf-5a19-461c-9987-3c53a1924a70 1073741824 Sep 01 02:09:14 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31fe1589-1f8d-4939-8d4f-9808d2e5eae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba3583a0-0454-4d29-97b3-2ad1257fbe4c', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a44cfc-adf7-4b15-9c00-1eba2bc07fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:14 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Volume volume-ba3583a0-0454-4d29-97b3-2ad1257fbe4c (ba3583a0-0454-4d29-97b3-2ad1257fbe4c): created successfully Sep 01 02:09:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a44cfc-adf7-4b15-9c00-1eba2bc07fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Flow 'volume_create_manager' (1e295d42-8913-46f9-8e7c-1d2b9eeea189) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:14 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_fvrykywzdevstack@QuobyteHD Sep 01 02:09:14 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:14 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-4db51a8c-ae1a-4257-b0c9-a15d64dba518 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Created volume successfully. Sep 01 02:09:15 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_fvrykywzdevstack@QuobyteHD" returned: 0 in 0.632s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:15 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] 64fc298b-4656-41e6-a52e-bd149cb491e9 was qcow2, converting to qcow2 {{(pid=87128) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:09:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_fvrykywzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7a9cb6f9-b98d-486b-b828-f15d6802d9b0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:15 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_fvrykywzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7a9cb6f9-b98d-486b-b828-f15d6802d9b0 Sep 01 02:09:15 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:15 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-00ed28bf-5a19-461c-9987-3c53a1924a70 1073741824" returned: 0 in 0.831s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:15 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=73,cinder:UPDATE=91,cinder:DELETE=12,cinder:INSERT=22 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:09:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-00ed28bf-5a19-461c-9987-3c53a1924a70 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:15 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-00ed28bf-5a19-461c-9987-3c53a1924a70 Sep 01 02:09:15 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:16 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-00ed28bf-5a19-461c-9987-3c53a1924a70" returned: 0 in 0.488s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.077s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-619133929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bbf2fa1-6df8-4a9c-a0d7-71389a92187b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb8a7e226c96401e8347e4b5cf9986d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:06Z,use_quota=True,user_id='77e1278ef6f242ed8bc6090f49de726a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Creating volume 7bbf2fa1-6df8-4a9c-a0d7-71389a92187b {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:16 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:09:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7bbf2fa1-6df8-4a9c-a0d7-71389a92187b 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:16 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7bbf2fa1-6df8-4a9c-a0d7-71389a92187b 1073741824 Sep 01 02:09:16 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d948efa-8689-4ab1-9378-345f655230d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00ed28bf-5a19-461c-9987-3c53a1924a70', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d2949d4-a652-4f7a-bb0e-1a1d3dd1f382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:16 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Volume volume-00ed28bf-5a19-461c-9987-3c53a1924a70 (00ed28bf-5a19-461c-9987-3c53a1924a70): created successfully Sep 01 02:09:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d2949d4-a652-4f7a-bb0e-1a1d3dd1f382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Flow 'volume_create_manager' (8415f908-f322-47da-bd46-0a9d71eeefc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:16 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-f5aa32ad-7cb8-4cfb-9bd2-b5ea2d02eae9 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Created volume successfully. Sep 01 02:09:16 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7bbf2fa1-6df8-4a9c-a0d7-71389a92187b 1073741824" returned: 0 in 0.815s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:16 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:09:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:17 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:09:17 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7bbf2fa1-6df8-4a9c-a0d7-71389a92187b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:17 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7bbf2fa1-6df8-4a9c-a0d7-71389a92187b Sep 01 02:09:17 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:17 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.584s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:17 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:17 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager._thread_info {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:09:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread count: 29 {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:09:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread info: [<_MainThread(MainThread, started 128688016527488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:09:17 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7bbf2fa1-6df8-4a9c-a0d7-71389a92187b" returned: 0 in 0.589s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.882s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2030675998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6add184a-a2c1-422f-aa1c-7eb3c1cbbd44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c9ee8aeebe4d74a77387ece6d1c22c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:09Z,use_quota=True,user_id='5f659abcc96c4f38a25e8d7f21f3f1eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] Creating volume 6add184a-a2c1-422f-aa1c-7eb3c1cbbd44 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:17 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:09:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:17 devstack sudo[100303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44 1073741824 Sep 01 02:09:17 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a8e6c9-f611-4b3b-8ce6-d8594393bb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bbf2fa1-6df8-4a9c-a0d7-71389a92187b', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ca72f0-40ac-4ac0-aff2-d9b8ee7dbfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:17 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Volume volume-7bbf2fa1-6df8-4a9c-a0d7-71389a92187b (7bbf2fa1-6df8-4a9c-a0d7-71389a92187b): created successfully Sep 01 02:09:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ca72f0-40ac-4ac0-aff2-d9b8ee7dbfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Flow 'volume_create_manager' (49861ec1-095a-4442-b6c3-369961f4a3ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:17 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-717d5874-1ec0-44ed-859e-8b2eef25c17f tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Created volume successfully. Sep 01 02:09:18 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44 1073741824" returned: 0 in 0.666s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:18 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_fvrykywzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7a9cb6f9-b98d-486b-b828-f15d6802d9b0" returned: 0 in 2.964s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:18 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_64fc298b-4656-41e6-a52e-bd149cb491e9_fvrykywzdevstack@QuobyteHD, size 112.00 MB, duration 2.97 sec, destination /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7a9cb6f9-b98d-486b-b828-f15d6802d9b0 {{(pid=87128) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:09:18 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Converted 112.00 MB image at 37.73 MB/s Sep 01 02:09:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7a9cb6f9-b98d-486b-b828-f15d6802d9b0 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:18 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7a9cb6f9-b98d-486b-b828-f15d6802d9b0 1G Sep 01 02:09:18 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:18 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44 Sep 01 02:09:18 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:18 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44" returned: 0 in 0.307s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.615s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-925700124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07a0c8e5-ddbd-4972-8655-c0ec968d6965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb8a7e226c96401e8347e4b5cf9986d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:09Z,use_quota=True,user_id='77e1278ef6f242ed8bc6090f49de726a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Creating volume 07a0c8e5-ddbd-4972-8655-c0ec968d6965 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:18 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:09:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-07a0c8e5-ddbd-4972-8655-c0ec968d6965 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:18 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-07a0c8e5-ddbd-4972-8655-c0ec968d6965 1073741824 Sep 01 02:09:18 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:18 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6be3943-9296-4a68-9833-5899656e9f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (645c06ae-7538-4ce1-8077-ab76a25cdfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7a9cb6f9-b98d-486b-b828-f15d6802d9b0 1G" returned: 0 in 0.474s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:18 devstack cinder-volume[87128]: DEBUG cinder.volume.volume_utils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Downloaded image 64fc298b-4656-41e6-a52e-bd149cb491e9 ((None, [{'url': 'file:///opt/stack/data/glance/images/64fc298b-4656-41e6-a52e-bd149cb491e9', 'metadata': {}}])) to volume 7a9cb6f9-b98d-486b-b828-f15d6802d9b0 successfully. {{(pid=87128) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:09:18 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Temporary image 64fc298b-4656-41e6-a52e-bd149cb491e9 for user 25fe52acf92549549a687eb0dd4743cf is deleted. {{(pid=87128) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:09:18 devstack cinder-volume[87128]: DEBUG cinder.volume.volume_utils [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Marking volume 7a9cb6f9-b98d-486b-b828-f15d6802d9b0 as bootable. {{(pid=87128) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:09:18 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] Volume volume-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44 (6add184a-a2c1-422f-aa1c-7eb3c1cbbd44): created successfully Sep 01 02:09:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (645c06ae-7538-4ce1-8077-ab76a25cdfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] Flow 'volume_create_manager' (457458d7-9f5c-4b9a-8fb3-5c882fe76784) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:18 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Copying metadata from image 64fc298b-4656-41e6-a52e-bd149cb491e9 to 7a9cb6f9-b98d-486b-b828-f15d6802d9b0. {{(pid=87128) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:09:18 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Creating volume glance metadata for volume 7a9cb6f9-b98d-486b-b828-f15d6802d9b0 backed by image 64fc298b-4656-41e6-a52e-bd149cb491e9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87128) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:09:18 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-9596a16c-1546-465e-98c5-0629328ce4fe tempest-VolumesActionsTest-420180064 None] Created volume successfully. Sep 01 02:09:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0887cc54-eafc-4b9c-8ea4-c696dcb8b59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a9cb6f9-b98d-486b-b828-f15d6802d9b0', 'volume_size': 1, 'image_id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64fc298b-4656-41e6-a52e-bd149cb491e9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0dbd8f0a33a74d5db3271102e89b70d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '64fc298b-4656-41e6-a52e-bd149cb491e9', 'created_at': datetime.datetime(2026, 8, 31, 23, 51, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 51, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64fc298b-4656-41e6-a52e-bd149cb491e9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05a4705-8b18-4bb8-aea9-e688189be384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:19 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Volume volume-7a9cb6f9-b98d-486b-b828-f15d6802d9b0 (7a9cb6f9-b98d-486b-b828-f15d6802d9b0): created successfully Sep 01 02:09:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05a4705-8b18-4bb8-aea9-e688189be384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Flow 'volume_create_manager' (c0a7f9f4-4090-4e0a-84d9-d857880d126d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:19 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-422d7835-0022-449d-b2c2-8494440ebfd7 tempest-VolumesGetTest-713710237 None] Created volume successfully. Sep 01 02:09:19 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-07a0c8e5-ddbd-4972-8655-c0ec968d6965 1073741824" returned: 0 in 0.611s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-07a0c8e5-ddbd-4972-8655-c0ec968d6965 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:19 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-07a0c8e5-ddbd-4972-8655-c0ec968d6965 Sep 01 02:09:19 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6e71ed11-49bf-423a-8604-dad7da2dd520 tempest-VolumesActionsTest-420180064 None] Acquiring lock "cinder-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44" by "attach_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6e71ed11-49bf-423a-8604-dad7da2dd520 tempest-VolumesActionsTest-420180064 None] Lock "cinder-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44" acquired by "attach_volume" :: waited 0.023s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:19 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-6e71ed11-49bf-423a-8604-dad7da2dd520 tempest-VolumesActionsTest-420180064 None] Attaching volume 6add184a-a2c1-422f-aa1c-7eb3c1cbbd44 to instance 079c07c7-65c7-452e-9ae0-d1726a83f07c at mountpoint /dev/vdb on host None. Sep 01 02:09:19 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-6e71ed11-49bf-423a-8604-dad7da2dd520 tempest-VolumesActionsTest-420180064 None] Attach volume completed successfully. Sep 01 02:09:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6e71ed11-49bf-423a-8604-dad7da2dd520 tempest-VolumesActionsTest-420180064 None] Lock "cinder-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44" released by "attach_volume" :: held 0.139s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:19 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-07a0c8e5-ddbd-4972-8655-c0ec968d6965" returned: 0 in 0.369s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:19 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (811c71f9-769b-4201-93b7-2da226b6fdb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07a0c8e5-ddbd-4972-8655-c0ec968d6965', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c3b1808-b09c-4c8e-95fb-b1ba6652e4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:19 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Volume volume-07a0c8e5-ddbd-4972-8655-c0ec968d6965 (07a0c8e5-ddbd-4972-8655-c0ec968d6965): created successfully Sep 01 02:09:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c3b1808-b09c-4c8e-95fb-b1ba6652e4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Flow 'volume_create_manager' (bdac38ea-e2dd-46d1-95ba-339e16790969) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:19 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-33af2ff6-fc88-48be-86df-4010f10ed8e3 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Created volume successfully. Sep 01 02:09:20 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-99d55daf-04fa-4314-81e3-dd4574d51a5a tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Acquiring lock "cinder-07a0c8e5-ddbd-4972-8655-c0ec968d6965-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:20 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-99d55daf-04fa-4314-81e3-dd4574d51a5a tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "cinder-07a0c8e5-ddbd-4972-8655-c0ec968d6965-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:20 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-99d55daf-04fa-4314-81e3-dd4574d51a5a tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Acquiring lock "cinder-quobyte-07a0c8e5-ddbd-4972-8655-c0ec968d6965" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:20 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-99d55daf-04fa-4314-81e3-dd4574d51a5a tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "cinder-quobyte-07a0c8e5-ddbd-4972-8655-c0ec968d6965" acquired by "delete_volume" :: waited 0.023s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:20 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea05c3c6-be35-4f3b-886b-dd79315b5b97]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-99d55daf-04fa-4314-81e3-dd4574d51a5a tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-07a0c8e5-ddbd-4972-8655-c0ec968d6965 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:20 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-17b00b1f-26e5-4512-89e9-cce80d1986ad tempest-VolumesActionsTest-1351940805 None] Terminate volume connection completed successfully. Sep 01 02:09:20 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-17b00b1f-26e5-4512-89e9-cce80d1986ad tempest-VolumesActionsTest-1351940805 None] Acquiring lock "cinder-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44-detach_volume" by "detach_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:20 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-17b00b1f-26e5-4512-89e9-cce80d1986ad tempest-VolumesActionsTest-1351940805 None] Lock "cinder-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:20 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-17b00b1f-26e5-4512-89e9-cce80d1986ad tempest-VolumesActionsTest-1351940805 None] Detaching volume 6add184a-a2c1-422f-aa1c-7eb3c1cbbd44 from instance 079c07c7-65c7-452e-9ae0-d1726a83f07c. Sep 01 02:09:20 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-07a0c8e5-ddbd-4972-8655-c0ec968d6965 Sep 01 02:09:20 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:20 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-17b00b1f-26e5-4512-89e9-cce80d1986ad tempest-VolumesActionsTest-1351940805 None] Detach volume completed successfully. Sep 01 02:09:20 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-17b00b1f-26e5-4512-89e9-cce80d1986ad tempest-VolumesActionsTest-1351940805 None] Lock "cinder-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44-detach_volume" released by "detach_volume" :: held 0.096s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:20 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ff642d1f-ecbe-4c80-ac74-74e9d46fccc4 tempest-VolumesActionsTest-420180064 None] Acquiring lock "cinder-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44-detach_volume" by "detach_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:20 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ff642d1f-ecbe-4c80-ac74-74e9d46fccc4 tempest-VolumesActionsTest-420180064 None] Lock "cinder-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:20 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-ff642d1f-ecbe-4c80-ac74-74e9d46fccc4 tempest-VolumesActionsTest-420180064 None] Volume detach called, but volume not attached. Sep 01 02:09:21 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-99d55daf-04fa-4314-81e3-dd4574d51a5a tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-07a0c8e5-ddbd-4972-8655-c0ec968d6965" returned: 0 in 0.569s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-99d55daf-04fa-4314-81e3-dd4574d51a5a tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-07a0c8e5-ddbd-4972-8655-c0ec968d6965 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ff642d1f-ecbe-4c80-ac74-74e9d46fccc4 tempest-VolumesActionsTest-420180064 None] Lock "cinder-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44-detach_volume" released by "detach_volume" :: held 0.034s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:21 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-07a0c8e5-ddbd-4972-8655-c0ec968d6965 Sep 01 02:09:21 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] Flow 'volume_create_manager' (d647980a-0a4b-460e-8c95-6e07f8e7a92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097320ce-5986-42a8-857e-e73c842d6a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097320ce-5986-42a8-857e-e73c842d6a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-837157428',display_name='tempest-VolumesGetTest-Volume-1173388939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2508f24-eee2-4f8c-86a3-08869189face,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='595efd53a81e48ac94b48cf90c593632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:21Z,use_quota=True,user_id='25fe52acf92549549a687eb0dd4743cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4265cfd1-8852-439e-9268-02d5e82c8d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4265cfd1-8852-439e-9268-02d5e82c8d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e4d4bd6-55f3-48d6-8ec5-d623534768fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e4d4bd6-55f3-48d6-8ec5-d623534768fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2508f24-eee2-4f8c-86a3-08869189face', 'volume_name': 'volume-c2508f24-eee2-4f8c-86a3-08869189face', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a47ae6fa-23e3-4275-93df-91a546351238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a47ae6fa-23e3-4275-93df-91a546351238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c6bb13-21c7-4b59-ac4f-9a3d8b994039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:21 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] Volume c2508f24-eee2-4f8c-86a3-08869189face: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2508f24-eee2-4f8c-86a3-08869189face', 'volume_size': 1} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-837157428',display_name='tempest-VolumesGetTest-Volume-1173388939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2508f24-eee2-4f8c-86a3-08869189face,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='595efd53a81e48ac94b48cf90c593632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:21Z,use_quota=True,user_id='25fe52acf92549549a687eb0dd4743cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] Creating volume c2508f24-eee2-4f8c-86a3-08869189face {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:21 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2508f24-eee2-4f8c-86a3-08869189face 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1159b676-0a58-4a4f-aac7-b6c2fd24f74e tempest-VolumesActionsTest-420180064 None] Acquiring lock "cinder-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:21 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2508f24-eee2-4f8c-86a3-08869189face 1073741824 Sep 01 02:09:21 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1159b676-0a58-4a4f-aac7-b6c2fd24f74e tempest-VolumesActionsTest-420180064 None] Lock "cinder-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:21 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-99d55daf-04fa-4314-81e3-dd4574d51a5a tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-07a0c8e5-ddbd-4972-8655-c0ec968d6965" returned: 0 in 0.360s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-99d55daf-04fa-4314-81e3-dd4574d51a5a tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "cinder-quobyte-07a0c8e5-ddbd-4972-8655-c0ec968d6965" released by "delete_volume" :: held 1.013s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1159b676-0a58-4a4f-aac7-b6c2fd24f74e tempest-VolumesActionsTest-420180064 None] Acquiring lock "cinder-quobyte-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1159b676-0a58-4a4f-aac7-b6c2fd24f74e tempest-VolumesActionsTest-420180064 None] Lock "cinder-quobyte-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44" acquired by "delete_volume" :: waited 0.031s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e2ea42-f193-45f3-ae9e-de53a5c582e2]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1159b676-0a58-4a4f-aac7-b6c2fd24f74e tempest-VolumesActionsTest-420180064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-99d55daf-04fa-4314-81e3-dd4574d51a5a tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Created reservations ['085d7e5a-534b-4b64-9a56-0526792783b5', '4f386d7e-8d76-4c98-8ca8-c2368978629c', 'f702e8ec-1c15-4dc6-a93d-5f5580ccea80', 'cef88ed8-5894-4444-a627-33df47b8f0cb'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-99d55daf-04fa-4314-81e3-dd4574d51a5a tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-99d55daf-04fa-4314-81e3-dd4574d51a5a tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-99d55daf-04fa-4314-81e3-dd4574d51a5a tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-99d55daf-04fa-4314-81e3-dd4574d51a5a tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-99d55daf-04fa-4314-81e3-dd4574d51a5a tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-99d55daf-04fa-4314-81e3-dd4574d51a5a tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:21 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:09:21 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:21 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44 Sep 01 02:09:21 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:21 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2508f24-eee2-4f8c-86a3-08869189face 1073741824" returned: 0 in 0.517s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:21 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-99d55daf-04fa-4314-81e3-dd4574d51a5a tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.273s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-99d55daf-04fa-4314-81e3-dd4574d51a5a tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:21 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-99d55daf-04fa-4314-81e3-dd4574d51a5a tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Deleted volume successfully. Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2508f24-eee2-4f8c-86a3-08869189face {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-99d55daf-04fa-4314-81e3-dd4574d51a5a tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "cinder-07a0c8e5-ddbd-4972-8655-c0ec968d6965-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:21 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2508f24-eee2-4f8c-86a3-08869189face Sep 01 02:09:21 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:21 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1159b676-0a58-4a4f-aac7-b6c2fd24f74e tempest-VolumesActionsTest-420180064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44" returned: 0 in 0.495s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1159b676-0a58-4a4f-aac7-b6c2fd24f74e tempest-VolumesActionsTest-420180064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:21 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44 Sep 01 02:09:21 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:22 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2508f24-eee2-4f8c-86a3-08869189face" returned: 0 in 0.269s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:22 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:22 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c6bb13-21c7-4b59-ac4f-9a3d8b994039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2508f24-eee2-4f8c-86a3-08869189face', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:22 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a4f34fc-c849-4321-b367-dcf1d14879f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:22 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] Volume volume-c2508f24-eee2-4f8c-86a3-08869189face (c2508f24-eee2-4f8c-86a3-08869189face): created successfully Sep 01 02:09:22 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a4f34fc-c849-4321-b367-dcf1d14879f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:22 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] Flow 'volume_create_manager' (d647980a-0a4b-460e-8c95-6e07f8e7a92c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:22 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-0df4b6ce-f0b7-48f7-ab24-db06a6e1555f tempest-VolumesGetTest-713710237 None] Created volume successfully. Sep 01 02:09:22 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1159b676-0a58-4a4f-aac7-b6c2fd24f74e tempest-VolumesActionsTest-420180064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44" returned: 0 in 0.255s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:22 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1159b676-0a58-4a4f-aac7-b6c2fd24f74e tempest-VolumesActionsTest-420180064 None] Lock "cinder-quobyte-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44" released by "delete_volume" :: held 0.802s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:22 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-1159b676-0a58-4a4f-aac7-b6c2fd24f74e tempest-VolumesActionsTest-420180064 None] Created reservations ['9e613ea9-75c6-487d-a84d-f53ce73d8199', '3424595a-008f-43d0-b2f7-82f1c0db1e4c', 'be8ce969-8142-4515-a5e0-846d2c30a14a', '927c52c0-39d2-4193-9f71-15145a8aae53'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1159b676-0a58-4a4f-aac7-b6c2fd24f74e tempest-VolumesActionsTest-420180064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1159b676-0a58-4a4f-aac7-b6c2fd24f74e tempest-VolumesActionsTest-420180064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:22 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1159b676-0a58-4a4f-aac7-b6c2fd24f74e tempest-VolumesActionsTest-420180064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:22 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1159b676-0a58-4a4f-aac7-b6c2fd24f74e tempest-VolumesActionsTest-420180064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1159b676-0a58-4a4f-aac7-b6c2fd24f74e tempest-VolumesActionsTest-420180064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1159b676-0a58-4a4f-aac7-b6c2fd24f74e tempest-VolumesActionsTest-420180064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:22 devstack sudo[100359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:09:22 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:22 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-11fb2423-cfa3-446b-8a73-45534ef95302 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Acquiring lock "cinder-7bbf2fa1-6df8-4a9c-a0d7-71389a92187b-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:22 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1159b676-0a58-4a4f-aac7-b6c2fd24f74e tempest-VolumesActionsTest-420180064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.317s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:22 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-1159b676-0a58-4a4f-aac7-b6c2fd24f74e tempest-VolumesActionsTest-420180064 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:22 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-11fb2423-cfa3-446b-8a73-45534ef95302 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "cinder-7bbf2fa1-6df8-4a9c-a0d7-71389a92187b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:22 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-1159b676-0a58-4a4f-aac7-b6c2fd24f74e tempest-VolumesActionsTest-420180064 None] Deleted volume successfully. Sep 01 02:09:22 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1159b676-0a58-4a4f-aac7-b6c2fd24f74e tempest-VolumesActionsTest-420180064 None] Lock "cinder-6add184a-a2c1-422f-aa1c-7eb3c1cbbd44-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:22 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-11fb2423-cfa3-446b-8a73-45534ef95302 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Acquiring lock "cinder-quobyte-7bbf2fa1-6df8-4a9c-a0d7-71389a92187b" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:22 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-11fb2423-cfa3-446b-8a73-45534ef95302 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "cinder-quobyte-7bbf2fa1-6df8-4a9c-a0d7-71389a92187b" acquired by "delete_volume" :: waited 0.025s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:22 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec543eb4-4d50-41b3-8b17-3e3f3d81729a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-11fb2423-cfa3-446b-8a73-45534ef95302 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7bbf2fa1-6df8-4a9c-a0d7-71389a92187b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:22 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7bbf2fa1-6df8-4a9c-a0d7-71389a92187b Sep 01 02:09:22 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-08e1652d-43ef-4bc0-8699-cb51d89507ce tempest-VolumesGetTest-713710237 None] Acquiring lock "cinder-c2508f24-eee2-4f8c-86a3-08869189face-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-08e1652d-43ef-4bc0-8699-cb51d89507ce tempest-VolumesGetTest-713710237 None] Lock "cinder-c2508f24-eee2-4f8c-86a3-08869189face-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-08e1652d-43ef-4bc0-8699-cb51d89507ce tempest-VolumesGetTest-713710237 None] Acquiring lock "cinder-quobyte-c2508f24-eee2-4f8c-86a3-08869189face" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-08e1652d-43ef-4bc0-8699-cb51d89507ce tempest-VolumesGetTest-713710237 None] Lock "cinder-quobyte-c2508f24-eee2-4f8c-86a3-08869189face" acquired by "delete_volume" :: waited 0.074s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:23 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:23 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[80208f83-a1db-49f7-9385-c29eeeb6af01]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-08e1652d-43ef-4bc0-8699-cb51d89507ce tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2508f24-eee2-4f8c-86a3-08869189face {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-11fb2423-cfa3-446b-8a73-45534ef95302 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7bbf2fa1-6df8-4a9c-a0d7-71389a92187b" returned: 0 in 0.861s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-11fb2423-cfa3-446b-8a73-45534ef95302 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7bbf2fa1-6df8-4a9c-a0d7-71389a92187b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:23 devstack sudo[100396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7bbf2fa1-6df8-4a9c-a0d7-71389a92187b Sep 01 02:09:23 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:23 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2508f24-eee2-4f8c-86a3-08869189face Sep 01 02:09:23 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:24 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-08e1652d-43ef-4bc0-8699-cb51d89507ce tempest-VolumesGetTest-713710237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2508f24-eee2-4f8c-86a3-08869189face" returned: 0 in 0.642s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-08e1652d-43ef-4bc0-8699-cb51d89507ce tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2508f24-eee2-4f8c-86a3-08869189face {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:24 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-11fb2423-cfa3-446b-8a73-45534ef95302 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7bbf2fa1-6df8-4a9c-a0d7-71389a92187b" returned: 0 in 0.663s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:24 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2508f24-eee2-4f8c-86a3-08869189face Sep 01 02:09:24 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-11fb2423-cfa3-446b-8a73-45534ef95302 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "cinder-quobyte-7bbf2fa1-6df8-4a9c-a0d7-71389a92187b" released by "delete_volume" :: held 1.619s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:24 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-11fb2423-cfa3-446b-8a73-45534ef95302 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Created reservations ['5ca90dd0-a0ed-4cc5-8145-cbe5acfea1b2', '85bc060e-bb7c-40e1-9d8c-730910a3a2c4', '3ab7db1f-cdec-479a-8670-fa44a9ba3f13', '41e61eb5-47b9-4922-b401-8c734b5deda0'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-11fb2423-cfa3-446b-8a73-45534ef95302 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-11fb2423-cfa3-446b-8a73-45534ef95302 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:24 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-11fb2423-cfa3-446b-8a73-45534ef95302 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:24 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-11fb2423-cfa3-446b-8a73-45534ef95302 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-11fb2423-cfa3-446b-8a73-45534ef95302 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-11fb2423-cfa3-446b-8a73-45534ef95302 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:24 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:09:24 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:24 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-08e1652d-43ef-4bc0-8699-cb51d89507ce tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2508f24-eee2-4f8c-86a3-08869189face" returned: 0 in 0.620s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-08e1652d-43ef-4bc0-8699-cb51d89507ce tempest-VolumesGetTest-713710237 None] Lock "cinder-quobyte-c2508f24-eee2-4f8c-86a3-08869189face" released by "delete_volume" :: held 1.325s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:25 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-11fb2423-cfa3-446b-8a73-45534ef95302 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.345s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:25 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-11fb2423-cfa3-446b-8a73-45534ef95302 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:25 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-11fb2423-cfa3-446b-8a73-45534ef95302 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Deleted volume successfully. Sep 01 02:09:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-11fb2423-cfa3-446b-8a73-45534ef95302 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "cinder-7bbf2fa1-6df8-4a9c-a0d7-71389a92187b-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:25 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-08e1652d-43ef-4bc0-8699-cb51d89507ce tempest-VolumesGetTest-713710237 None] Created reservations ['3ab5aea6-d644-453b-9a99-70638fed134a', '6fac8b52-1703-4b63-a30b-2911da368b74', '64a1cc28-543e-4aa9-9010-30677c4da51e', '2c474040-06f3-4864-94d3-e8a8021dcde1'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-432eecc3-1434-485d-905e-123e4439cc93 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Acquiring lock "cinder-00ed28bf-5a19-461c-9987-3c53a1924a70-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-08e1652d-43ef-4bc0-8699-cb51d89507ce tempest-VolumesGetTest-713710237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-08e1652d-43ef-4bc0-8699-cb51d89507ce tempest-VolumesGetTest-713710237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-08e1652d-43ef-4bc0-8699-cb51d89507ce tempest-VolumesGetTest-713710237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-08e1652d-43ef-4bc0-8699-cb51d89507ce tempest-VolumesGetTest-713710237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-08e1652d-43ef-4bc0-8699-cb51d89507ce tempest-VolumesGetTest-713710237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-08e1652d-43ef-4bc0-8699-cb51d89507ce tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:25 devstack sudo[100441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:09:25 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-432eecc3-1434-485d-905e-123e4439cc93 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "cinder-00ed28bf-5a19-461c-9987-3c53a1924a70-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-432eecc3-1434-485d-905e-123e4439cc93 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Acquiring lock "cinder-quobyte-00ed28bf-5a19-461c-9987-3c53a1924a70" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-432eecc3-1434-485d-905e-123e4439cc93 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "cinder-quobyte-00ed28bf-5a19-461c-9987-3c53a1924a70" acquired by "delete_volume" :: waited 0.023s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:25 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[1471343e-4e75-4663-b837-cc31250567a3]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-432eecc3-1434-485d-905e-123e4439cc93 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-00ed28bf-5a19-461c-9987-3c53a1924a70 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:25 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-00ed28bf-5a19-461c-9987-3c53a1924a70 Sep 01 02:09:25 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:25 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-08e1652d-43ef-4bc0-8699-cb51d89507ce tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.327s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:25 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-08e1652d-43ef-4bc0-8699-cb51d89507ce tempest-VolumesGetTest-713710237 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:25 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-08e1652d-43ef-4bc0-8699-cb51d89507ce tempest-VolumesGetTest-713710237 None] Deleted volume successfully. Sep 01 02:09:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-08e1652d-43ef-4bc0-8699-cb51d89507ce tempest-VolumesGetTest-713710237 None] Lock "cinder-c2508f24-eee2-4f8c-86a3-08869189face-delete_volume" released by "delete_volume" :: held 2.172s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:25 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-432eecc3-1434-485d-905e-123e4439cc93 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-00ed28bf-5a19-461c-9987-3c53a1924a70" returned: 0 in 0.461s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-432eecc3-1434-485d-905e-123e4439cc93 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-00ed28bf-5a19-461c-9987-3c53a1924a70 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:25 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-00ed28bf-5a19-461c-9987-3c53a1924a70 Sep 01 02:09:25 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:26 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6a0b3a5f-fe9c-49f7-9027-a724331136a6 tempest-VolumesGetTest-713710237 None] Acquiring lock "cinder-7a9cb6f9-b98d-486b-b828-f15d6802d9b0-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:26 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6a0b3a5f-fe9c-49f7-9027-a724331136a6 tempest-VolumesGetTest-713710237 None] Lock "cinder-7a9cb6f9-b98d-486b-b828-f15d6802d9b0-delete_volume" acquired by "delete_volume" :: waited 0.135s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:26 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6a0b3a5f-fe9c-49f7-9027-a724331136a6 tempest-VolumesGetTest-713710237 None] Acquiring lock "cinder-quobyte-7a9cb6f9-b98d-486b-b828-f15d6802d9b0" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:26 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6a0b3a5f-fe9c-49f7-9027-a724331136a6 tempest-VolumesGetTest-713710237 None] Lock "cinder-quobyte-7a9cb6f9-b98d-486b-b828-f15d6802d9b0" acquired by "delete_volume" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:26 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-432eecc3-1434-485d-905e-123e4439cc93 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-00ed28bf-5a19-461c-9987-3c53a1924a70" returned: 0 in 0.313s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:26 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[1835bdbc-63c3-4757-9cfd-7c12b79783a2]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6a0b3a5f-fe9c-49f7-9027-a724331136a6 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7a9cb6f9-b98d-486b-b828-f15d6802d9b0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:26 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-432eecc3-1434-485d-905e-123e4439cc93 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "cinder-quobyte-00ed28bf-5a19-461c-9987-3c53a1924a70" released by "delete_volume" :: held 0.841s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:26 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-432eecc3-1434-485d-905e-123e4439cc93 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Created reservations ['6de8643b-baf4-44eb-95e4-070b6c85f962', 'af532169-eedf-4784-bf6a-4634a8ae5c31', '0ff16e37-89c4-4978-92e3-0af0c736c601', '61623370-6fdb-415e-b9ec-efc78a0df8b5'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:26 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7a9cb6f9-b98d-486b-b828-f15d6802d9b0 Sep 01 02:09:26 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-432eecc3-1434-485d-905e-123e4439cc93 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-432eecc3-1434-485d-905e-123e4439cc93 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:26 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-432eecc3-1434-485d-905e-123e4439cc93 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:26 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-432eecc3-1434-485d-905e-123e4439cc93 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-432eecc3-1434-485d-905e-123e4439cc93 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-432eecc3-1434-485d-905e-123e4439cc93 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:26 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:09:26 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:26 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-432eecc3-1434-485d-905e-123e4439cc93 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.311s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:26 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-432eecc3-1434-485d-905e-123e4439cc93 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:26 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-432eecc3-1434-485d-905e-123e4439cc93 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Deleted volume successfully. Sep 01 02:09:26 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:26 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-432eecc3-1434-485d-905e-123e4439cc93 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "cinder-00ed28bf-5a19-461c-9987-3c53a1924a70-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6a0b3a5f-fe9c-49f7-9027-a724331136a6 tempest-VolumesGetTest-713710237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7a9cb6f9-b98d-486b-b828-f15d6802d9b0" returned: 0 in 0.666s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6a0b3a5f-fe9c-49f7-9027-a724331136a6 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7a9cb6f9-b98d-486b-b828-f15d6802d9b0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:26 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7a9cb6f9-b98d-486b-b828-f15d6802d9b0 Sep 01 02:09:26 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] Flow 'volume_create_manager' (f7d8dbba-bd2e-425a-9c36-ce30f4c736b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b455c646-5fb0-4714-892c-b798bca8719e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b455c646-5fb0-4714-892c-b798bca8719e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1015323063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d65f1ccd-28ab-44bc-8ce7-c58c95a24a7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c9ee8aeebe4d74a77387ece6d1c22c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:27Z,use_quota=True,user_id='5f659abcc96c4f38a25e8d7f21f3f1eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (807febea-7888-4456-addf-6bf30a0fd2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (807febea-7888-4456-addf-6bf30a0fd2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa498ebf-4cc2-4404-a8f1-808e2f030e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa498ebf-4cc2-4404-a8f1-808e2f030e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd65f1ccd-28ab-44bc-8ce7-c58c95a24a7f', 'volume_name': 'volume-d65f1ccd-28ab-44bc-8ce7-c58c95a24a7f', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca306557-60c9-4bf7-addf-9991ffb04c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca306557-60c9-4bf7-addf-9991ffb04c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d84f8a-5543-474b-ae0f-d53acbef3088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:27 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] Volume d65f1ccd-28ab-44bc-8ce7-c58c95a24a7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d65f1ccd-28ab-44bc-8ce7-c58c95a24a7f', 'volume_size': 1} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1015323063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d65f1ccd-28ab-44bc-8ce7-c58c95a24a7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c9ee8aeebe4d74a77387ece6d1c22c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:27Z,use_quota=True,user_id='5f659abcc96c4f38a25e8d7f21f3f1eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] Creating volume d65f1ccd-28ab-44bc-8ce7-c58c95a24a7f {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:27 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d65f1ccd-28ab-44bc-8ce7-c58c95a24a7f 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:27 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6a0b3a5f-fe9c-49f7-9027-a724331136a6 tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7a9cb6f9-b98d-486b-b828-f15d6802d9b0" returned: 0 in 0.328s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:27 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d65f1ccd-28ab-44bc-8ce7-c58c95a24a7f 1073741824 Sep 01 02:09:27 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6a0b3a5f-fe9c-49f7-9027-a724331136a6 tempest-VolumesGetTest-713710237 None] Lock "cinder-quobyte-7a9cb6f9-b98d-486b-b828-f15d6802d9b0" released by "delete_volume" :: held 1.046s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-6a0b3a5f-fe9c-49f7-9027-a724331136a6 tempest-VolumesGetTest-713710237 None] Created reservations ['6f016d12-d641-4df3-a14f-4fea579c6d71', '48dc1500-e874-4349-842c-103abc03e12d', '3a191c46-0c88-42e1-a08f-0abf50a4466a', '68109713-a235-4ae3-be16-db00028f8e75'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6a0b3a5f-fe9c-49f7-9027-a724331136a6 tempest-VolumesGetTest-713710237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6a0b3a5f-fe9c-49f7-9027-a724331136a6 tempest-VolumesGetTest-713710237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-6a0b3a5f-fe9c-49f7-9027-a724331136a6 tempest-VolumesGetTest-713710237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-6a0b3a5f-fe9c-49f7-9027-a724331136a6 tempest-VolumesGetTest-713710237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6a0b3a5f-fe9c-49f7-9027-a724331136a6 tempest-VolumesGetTest-713710237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6a0b3a5f-fe9c-49f7-9027-a724331136a6 tempest-VolumesGetTest-713710237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:27 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:09:27 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3b8ff6b5-023c-414c-9284-0300cf479ee5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Acquiring lock "cinder-ba3583a0-0454-4d29-97b3-2ad1257fbe4c-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3b8ff6b5-023c-414c-9284-0300cf479ee5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "cinder-ba3583a0-0454-4d29-97b3-2ad1257fbe4c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3b8ff6b5-023c-414c-9284-0300cf479ee5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Acquiring lock "cinder-quobyte-ba3583a0-0454-4d29-97b3-2ad1257fbe4c" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3b8ff6b5-023c-414c-9284-0300cf479ee5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "cinder-quobyte-ba3583a0-0454-4d29-97b3-2ad1257fbe4c" acquired by "delete_volume" :: waited 0.020s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:27 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e8e0db-2433-4afe-85ae-3f099750312b]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3b8ff6b5-023c-414c-9284-0300cf479ee5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ba3583a0-0454-4d29-97b3-2ad1257fbe4c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6a0b3a5f-fe9c-49f7-9027-a724331136a6 tempest-VolumesGetTest-713710237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.353s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-6a0b3a5f-fe9c-49f7-9027-a724331136a6 tempest-VolumesGetTest-713710237 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:27 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-6a0b3a5f-fe9c-49f7-9027-a724331136a6 tempest-VolumesGetTest-713710237 None] Deleted volume successfully. Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6a0b3a5f-fe9c-49f7-9027-a724331136a6 tempest-VolumesGetTest-713710237 None] Lock "cinder-7a9cb6f9-b98d-486b-b828-f15d6802d9b0-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:27 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d65f1ccd-28ab-44bc-8ce7-c58c95a24a7f 1073741824" returned: 0 in 0.598s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d65f1ccd-28ab-44bc-8ce7-c58c95a24a7f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:27 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d65f1ccd-28ab-44bc-8ce7-c58c95a24a7f Sep 01 02:09:27 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ba3583a0-0454-4d29-97b3-2ad1257fbe4c Sep 01 02:09:27 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:27 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:28 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d65f1ccd-28ab-44bc-8ce7-c58c95a24a7f" returned: 0 in 0.265s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:28 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:28 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d84f8a-5543-474b-ae0f-d53acbef3088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d65f1ccd-28ab-44bc-8ce7-c58c95a24a7f', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1adec05b-552c-4c1d-a9c5-1b0e7f0bd770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3b8ff6b5-023c-414c-9284-0300cf479ee5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ba3583a0-0454-4d29-97b3-2ad1257fbe4c" returned: 0 in 0.409s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3b8ff6b5-023c-414c-9284-0300cf479ee5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ba3583a0-0454-4d29-97b3-2ad1257fbe4c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:28 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] Volume volume-d65f1ccd-28ab-44bc-8ce7-c58c95a24a7f (d65f1ccd-28ab-44bc-8ce7-c58c95a24a7f): created successfully Sep 01 02:09:28 devstack sudo[100488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ba3583a0-0454-4d29-97b3-2ad1257fbe4c Sep 01 02:09:28 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1adec05b-552c-4c1d-a9c5-1b0e7f0bd770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] Flow 'volume_create_manager' (f7d8dbba-bd2e-425a-9c36-ce30f4c736b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:28 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-206787be-7b39-4dd6-bec9-6b729b844d9f tempest-VolumesActionsTest-420180064 None] Created volume successfully. Sep 01 02:09:28 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3b8ff6b5-023c-414c-9284-0300cf479ee5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ba3583a0-0454-4d29-97b3-2ad1257fbe4c" returned: 0 in 0.261s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:28 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3b8ff6b5-023c-414c-9284-0300cf479ee5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "cinder-quobyte-ba3583a0-0454-4d29-97b3-2ad1257fbe4c" released by "delete_volume" :: held 0.711s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:28 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-3b8ff6b5-023c-414c-9284-0300cf479ee5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Created reservations ['bdd2a155-c966-46ef-96f4-a084f96e0582', 'dce106fd-142e-44a3-8037-8578ab920028', '97431672-4c1b-4c25-b6f9-c3ebfb3971eb', 'c288d878-08f5-4953-b1c9-9d9171918d3b'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3b8ff6b5-023c-414c-9284-0300cf479ee5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3b8ff6b5-023c-414c-9284-0300cf479ee5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:28 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3b8ff6b5-023c-414c-9284-0300cf479ee5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:28 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3b8ff6b5-023c-414c-9284-0300cf479ee5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3b8ff6b5-023c-414c-9284-0300cf479ee5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3b8ff6b5-023c-414c-9284-0300cf479ee5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:28 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:09:28 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:28 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3b8ff6b5-023c-414c-9284-0300cf479ee5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.259s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:28 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-3b8ff6b5-023c-414c-9284-0300cf479ee5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:28 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-42c3522e-d127-44af-bebe-2da42232d80c tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Acquiring lock "cinder-a0e75714-6e31-4d33-a3ba-c56a4c3e7af0-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:28 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-3b8ff6b5-023c-414c-9284-0300cf479ee5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Deleted volume successfully. Sep 01 02:09:28 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-42c3522e-d127-44af-bebe-2da42232d80c tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "cinder-a0e75714-6e31-4d33-a3ba-c56a4c3e7af0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:28 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3b8ff6b5-023c-414c-9284-0300cf479ee5 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "cinder-ba3583a0-0454-4d29-97b3-2ad1257fbe4c-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:28 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-42c3522e-d127-44af-bebe-2da42232d80c tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Acquiring lock "cinder-quobyte-a0e75714-6e31-4d33-a3ba-c56a4c3e7af0" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:28 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-42c3522e-d127-44af-bebe-2da42232d80c tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "cinder-quobyte-a0e75714-6e31-4d33-a3ba-c56a4c3e7af0" acquired by "delete_volume" :: waited 0.030s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:28 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a2edbe-b2de-4575-839f-b28730d3d072]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-42c3522e-d127-44af-bebe-2da42232d80c tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a0e75714-6e31-4d33-a3ba-c56a4c3e7af0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:29 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a0e75714-6e31-4d33-a3ba-c56a4c3e7af0 Sep 01 02:09:29 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:29 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e2b72cb8-2c1d-4002-bcd7-50b49cf76141 tempest-VolumesActionsTest-1351940805 None] Acquiring lock "cinder-d65f1ccd-28ab-44bc-8ce7-c58c95a24a7f-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:29 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e2b72cb8-2c1d-4002-bcd7-50b49cf76141 tempest-VolumesActionsTest-1351940805 None] Lock "cinder-d65f1ccd-28ab-44bc-8ce7-c58c95a24a7f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:29 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e2b72cb8-2c1d-4002-bcd7-50b49cf76141 tempest-VolumesActionsTest-1351940805 None] Acquiring lock "cinder-quobyte-d65f1ccd-28ab-44bc-8ce7-c58c95a24a7f" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:29 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e2b72cb8-2c1d-4002-bcd7-50b49cf76141 tempest-VolumesActionsTest-1351940805 None] Lock "cinder-quobyte-d65f1ccd-28ab-44bc-8ce7-c58c95a24a7f" acquired by "delete_volume" :: waited 0.021s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:29 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a406ae-49f4-4203-9b0c-16c5cc11fd00]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e2b72cb8-2c1d-4002-bcd7-50b49cf76141 tempest-VolumesActionsTest-1351940805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d65f1ccd-28ab-44bc-8ce7-c58c95a24a7f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:29 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-42c3522e-d127-44af-bebe-2da42232d80c tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a0e75714-6e31-4d33-a3ba-c56a4c3e7af0" returned: 0 in 0.577s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-42c3522e-d127-44af-bebe-2da42232d80c tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a0e75714-6e31-4d33-a3ba-c56a4c3e7af0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:29 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a0e75714-6e31-4d33-a3ba-c56a4c3e7af0 Sep 01 02:09:29 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:29 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d65f1ccd-28ab-44bc-8ce7-c58c95a24a7f Sep 01 02:09:29 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:29 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-42c3522e-d127-44af-bebe-2da42232d80c tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a0e75714-6e31-4d33-a3ba-c56a4c3e7af0" returned: 0 in 0.286s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:29 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-42c3522e-d127-44af-bebe-2da42232d80c tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "cinder-quobyte-a0e75714-6e31-4d33-a3ba-c56a4c3e7af0" released by "delete_volume" :: held 0.914s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:29 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-42c3522e-d127-44af-bebe-2da42232d80c tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Created reservations ['6cc79646-662c-4e73-86db-a4539e3d3337', '512e9421-4d95-423b-a064-63d91cfcf383', '48e9df55-df84-4084-84df-d1f8294f364a', 'a359262c-0adf-44cf-a88d-f4cd63cf75a6'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:30 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e2b72cb8-2c1d-4002-bcd7-50b49cf76141 tempest-VolumesActionsTest-1351940805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d65f1ccd-28ab-44bc-8ce7-c58c95a24a7f" returned: 0 in 0.510s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e2b72cb8-2c1d-4002-bcd7-50b49cf76141 tempest-VolumesActionsTest-1351940805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d65f1ccd-28ab-44bc-8ce7-c58c95a24a7f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-42c3522e-d127-44af-bebe-2da42232d80c tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-42c3522e-d127-44af-bebe-2da42232d80c tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-42c3522e-d127-44af-bebe-2da42232d80c tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:30 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d65f1ccd-28ab-44bc-8ce7-c58c95a24a7f Sep 01 02:09:30 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-42c3522e-d127-44af-bebe-2da42232d80c tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-42c3522e-d127-44af-bebe-2da42232d80c tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-42c3522e-d127-44af-bebe-2da42232d80c tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:30 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:09:30 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:30 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e2b72cb8-2c1d-4002-bcd7-50b49cf76141 tempest-VolumesActionsTest-1351940805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d65f1ccd-28ab-44bc-8ce7-c58c95a24a7f" returned: 0 in 0.336s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:30 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e2b72cb8-2c1d-4002-bcd7-50b49cf76141 tempest-VolumesActionsTest-1351940805 None] Lock "cinder-quobyte-d65f1ccd-28ab-44bc-8ce7-c58c95a24a7f" released by "delete_volume" :: held 0.905s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:30 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-42c3522e-d127-44af-bebe-2da42232d80c tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.330s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:30 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-42c3522e-d127-44af-bebe-2da42232d80c tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:30 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-42c3522e-d127-44af-bebe-2da42232d80c tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Deleted volume successfully. Sep 01 02:09:30 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-42c3522e-d127-44af-bebe-2da42232d80c tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "cinder-a0e75714-6e31-4d33-a3ba-c56a4c3e7af0-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:30 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-e2b72cb8-2c1d-4002-bcd7-50b49cf76141 tempest-VolumesActionsTest-1351940805 None] Created reservations ['42f18a6a-0cf5-4ea4-a660-353e278a97bd', '1bac2bde-384e-4c58-acbf-5a2ab72f814e', '3cd64f00-6e9a-438d-bbea-a3afb378621e', 'bc3b6ad7-22b8-4ca5-9524-d5490d9b2e2b'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e2b72cb8-2c1d-4002-bcd7-50b49cf76141 tempest-VolumesActionsTest-1351940805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e2b72cb8-2c1d-4002-bcd7-50b49cf76141 tempest-VolumesActionsTest-1351940805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e2b72cb8-2c1d-4002-bcd7-50b49cf76141 tempest-VolumesActionsTest-1351940805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e2b72cb8-2c1d-4002-bcd7-50b49cf76141 tempest-VolumesActionsTest-1351940805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e2b72cb8-2c1d-4002-bcd7-50b49cf76141 tempest-VolumesActionsTest-1351940805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e2b72cb8-2c1d-4002-bcd7-50b49cf76141 tempest-VolumesActionsTest-1351940805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:30 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:09:30 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:30 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e2b72cb8-2c1d-4002-bcd7-50b49cf76141 tempest-VolumesActionsTest-1351940805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.263s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:30 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-e2b72cb8-2c1d-4002-bcd7-50b49cf76141 tempest-VolumesActionsTest-1351940805 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:30 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-e2b72cb8-2c1d-4002-bcd7-50b49cf76141 tempest-VolumesActionsTest-1351940805 None] Deleted volume successfully. Sep 01 02:09:30 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e2b72cb8-2c1d-4002-bcd7-50b49cf76141 tempest-VolumesActionsTest-1351940805 None] Lock "cinder-d65f1ccd-28ab-44bc-8ce7-c58c95a24a7f-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:31 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f5e704d6-e505-4768-bb9c-2d34a3ecad18 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Acquiring lock "cinder-16a59495-5172-481e-9bb2-facfac4c167f-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:31 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f5e704d6-e505-4768-bb9c-2d34a3ecad18 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "cinder-16a59495-5172-481e-9bb2-facfac4c167f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:31 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f5e704d6-e505-4768-bb9c-2d34a3ecad18 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Acquiring lock "cinder-quobyte-16a59495-5172-481e-9bb2-facfac4c167f" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:31 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f5e704d6-e505-4768-bb9c-2d34a3ecad18 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "cinder-quobyte-16a59495-5172-481e-9bb2-facfac4c167f" acquired by "delete_volume" :: waited 0.032s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:31 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[7805d312-76f4-4c6f-8eef-6d1a73fb6085]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f5e704d6-e505-4768-bb9c-2d34a3ecad18 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-16a59495-5172-481e-9bb2-facfac4c167f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:31 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-16a59495-5172-481e-9bb2-facfac4c167f Sep 01 02:09:31 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:31 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f5e704d6-e505-4768-bb9c-2d34a3ecad18 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-16a59495-5172-481e-9bb2-facfac4c167f" returned: 0 in 0.474s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f5e704d6-e505-4768-bb9c-2d34a3ecad18 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-16a59495-5172-481e-9bb2-facfac4c167f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:31 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-16a59495-5172-481e-9bb2-facfac4c167f Sep 01 02:09:31 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:32 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f5e704d6-e505-4768-bb9c-2d34a3ecad18 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-16a59495-5172-481e-9bb2-facfac4c167f" returned: 0 in 0.283s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f5e704d6-e505-4768-bb9c-2d34a3ecad18 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "cinder-quobyte-16a59495-5172-481e-9bb2-facfac4c167f" released by "delete_volume" :: held 0.827s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-f5e704d6-e505-4768-bb9c-2d34a3ecad18 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Created reservations ['6e3b2421-95f9-4bea-b6c1-1049df7da727', 'd4f6f358-9e8e-42dc-8e0e-d56f709ac862', '39dc94b0-9cea-4fbb-be43-37c6c5ccf18b', '45debbc1-3481-4ca5-8721-00e86b34a0c5'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f5e704d6-e505-4768-bb9c-2d34a3ecad18 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f5e704d6-e505-4768-bb9c-2d34a3ecad18 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f5e704d6-e505-4768-bb9c-2d34a3ecad18 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f5e704d6-e505-4768-bb9c-2d34a3ecad18 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f5e704d6-e505-4768-bb9c-2d34a3ecad18 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f5e704d6-e505-4768-bb9c-2d34a3ecad18 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:32 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:09:32 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] Flow 'volume_create_manager' (03248a49-0add-403a-8a63-91073b24210d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d5efd8-c05d-4a7d-86dd-19a733b7a05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d5efd8-c05d-4a7d-86dd-19a733b7a05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1006655837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27093c0a-85db-492f-bc20-73d72cd44cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c9ee8aeebe4d74a77387ece6d1c22c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:32Z,use_quota=True,user_id='5f659abcc96c4f38a25e8d7f21f3f1eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e25565-db5a-4c37-b8d7-a119144f6100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e25565-db5a-4c37-b8d7-a119144f6100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d8c1e9-0677-4db1-b785-50efb0a13ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d8c1e9-0677-4db1-b785-50efb0a13ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27093c0a-85db-492f-bc20-73d72cd44cb0', 'volume_name': 'volume-27093c0a-85db-492f-bc20-73d72cd44cb0', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6df4a7-6777-4e87-bf15-92ab17c80770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6df4a7-6777-4e87-bf15-92ab17c80770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91526e69-1163-4d9e-8eda-a5e28ddd4e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:32 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] Volume 27093c0a-85db-492f-bc20-73d72cd44cb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27093c0a-85db-492f-bc20-73d72cd44cb0', 'volume_size': 1} Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1006655837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27093c0a-85db-492f-bc20-73d72cd44cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c9ee8aeebe4d74a77387ece6d1c22c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:32Z,use_quota=True,user_id='5f659abcc96c4f38a25e8d7f21f3f1eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] Creating volume 27093c0a-85db-492f-bc20-73d72cd44cb0 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:32 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-27093c0a-85db-492f-bc20-73d72cd44cb0 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:32 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-27093c0a-85db-492f-bc20-73d72cd44cb0 1073741824 Sep 01 02:09:32 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:32 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f5e704d6-e505-4768-bb9c-2d34a3ecad18 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.441s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-f5e704d6-e505-4768-bb9c-2d34a3ecad18 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:32 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-f5e704d6-e505-4768-bb9c-2d34a3ecad18 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Deleted volume successfully. Sep 01 02:09:32 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f5e704d6-e505-4768-bb9c-2d34a3ecad18 tempest-CreateVolumesFromSourceVolumeTest-1789131770 None] Lock "cinder-16a59495-5172-481e-9bb2-facfac4c167f-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:33 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-27093c0a-85db-492f-bc20-73d72cd44cb0 1073741824" returned: 0 in 0.640s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-27093c0a-85db-492f-bc20-73d72cd44cb0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:33 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-27093c0a-85db-492f-bc20-73d72cd44cb0 Sep 01 02:09:33 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:33 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-27093c0a-85db-492f-bc20-73d72cd44cb0" returned: 0 in 0.274s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91526e69-1163-4d9e-8eda-a5e28ddd4e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27093c0a-85db-492f-bc20-73d72cd44cb0', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c87f041-01e2-41f9-bade-fcb91ed0d935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:33 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] Volume volume-27093c0a-85db-492f-bc20-73d72cd44cb0 (27093c0a-85db-492f-bc20-73d72cd44cb0): created successfully Sep 01 02:09:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c87f041-01e2-41f9-bade-fcb91ed0d935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] Flow 'volume_create_manager' (03248a49-0add-403a-8a63-91073b24210d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:33 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-3f128b84-eb27-4476-b92a-6c704e135924 tempest-VolumesActionsTest-420180064 None] Created volume successfully. Sep 01 02:09:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f38eae77-3a24-43ae-9c23-6117eff684a4 tempest-VolumesActionsTest-1351940805 None] Acquiring lock "cinder-27093c0a-85db-492f-bc20-73d72cd44cb0-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f38eae77-3a24-43ae-9c23-6117eff684a4 tempest-VolumesActionsTest-1351940805 None] Lock "cinder-27093c0a-85db-492f-bc20-73d72cd44cb0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f38eae77-3a24-43ae-9c23-6117eff684a4 tempest-VolumesActionsTest-1351940805 None] Acquiring lock "cinder-quobyte-27093c0a-85db-492f-bc20-73d72cd44cb0" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f38eae77-3a24-43ae-9c23-6117eff684a4 tempest-VolumesActionsTest-1351940805 None] Lock "cinder-quobyte-27093c0a-85db-492f-bc20-73d72cd44cb0" acquired by "delete_volume" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:34 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d85c21-d084-4936-9c99-5f7bf3f5d98c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f38eae77-3a24-43ae-9c23-6117eff684a4 tempest-VolumesActionsTest-1351940805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-27093c0a-85db-492f-bc20-73d72cd44cb0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:34 devstack sudo[100545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-27093c0a-85db-492f-bc20-73d72cd44cb0 Sep 01 02:09:34 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:35 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f38eae77-3a24-43ae-9c23-6117eff684a4 tempest-VolumesActionsTest-1351940805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-27093c0a-85db-492f-bc20-73d72cd44cb0" returned: 0 in 0.408s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f38eae77-3a24-43ae-9c23-6117eff684a4 tempest-VolumesActionsTest-1351940805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-27093c0a-85db-492f-bc20-73d72cd44cb0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:35 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-27093c0a-85db-492f-bc20-73d72cd44cb0 Sep 01 02:09:35 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:35 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f38eae77-3a24-43ae-9c23-6117eff684a4 tempest-VolumesActionsTest-1351940805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-27093c0a-85db-492f-bc20-73d72cd44cb0" returned: 0 in 0.283s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f38eae77-3a24-43ae-9c23-6117eff684a4 tempest-VolumesActionsTest-1351940805 None] Lock "cinder-quobyte-27093c0a-85db-492f-bc20-73d72cd44cb0" released by "delete_volume" :: held 0.736s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:35 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-f38eae77-3a24-43ae-9c23-6117eff684a4 tempest-VolumesActionsTest-1351940805 None] Created reservations ['5627f4a6-3a3d-4559-93bd-d404a6681fac', '34fb453e-7881-4077-84f2-b0f4d472db5c', '93490d62-b613-461c-ba66-03134c1974e2', 'cf0b107d-4251-46ef-94da-4b1b53925baa'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f38eae77-3a24-43ae-9c23-6117eff684a4 tempest-VolumesActionsTest-1351940805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f38eae77-3a24-43ae-9c23-6117eff684a4 tempest-VolumesActionsTest-1351940805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:35 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f38eae77-3a24-43ae-9c23-6117eff684a4 tempest-VolumesActionsTest-1351940805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:35 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f38eae77-3a24-43ae-9c23-6117eff684a4 tempest-VolumesActionsTest-1351940805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f38eae77-3a24-43ae-9c23-6117eff684a4 tempest-VolumesActionsTest-1351940805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f38eae77-3a24-43ae-9c23-6117eff684a4 tempest-VolumesActionsTest-1351940805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:35 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:09:35 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:35 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f38eae77-3a24-43ae-9c23-6117eff684a4 tempest-VolumesActionsTest-1351940805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.279s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:35 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-f38eae77-3a24-43ae-9c23-6117eff684a4 tempest-VolumesActionsTest-1351940805 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:35 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-f38eae77-3a24-43ae-9c23-6117eff684a4 tempest-VolumesActionsTest-1351940805 None] Deleted volume successfully. Sep 01 02:09:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-f38eae77-3a24-43ae-9c23-6117eff684a4 tempest-VolumesActionsTest-1351940805 None] Lock "cinder-27093c0a-85db-492f-bc20-73d72cd44cb0-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:36 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] Flow 'volume_create_manager' (2584bae5-6981-47e8-a9d9-7f39941e8d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53cf0a6e-d5cd-4e6d-aa05-837aa77e716e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53cf0a6e-d5cd-4e6d-aa05-837aa77e716e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1505191513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f55351a-3dbe-4cf9-98b1-c0241e316de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c9ee8aeebe4d74a77387ece6d1c22c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:36Z,use_quota=True,user_id='5f659abcc96c4f38a25e8d7f21f3f1eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1914906a-8ac6-4549-a39e-d93fb0151d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1914906a-8ac6-4549-a39e-d93fb0151d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e54358db-7e6c-4b0e-a2f0-fe73db2f55af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e54358db-7e6c-4b0e-a2f0-fe73db2f55af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f55351a-3dbe-4cf9-98b1-c0241e316de0', 'volume_name': 'volume-6f55351a-3dbe-4cf9-98b1-c0241e316de0', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7a1443-bdf1-4ad3-80d2-e7891524bfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7a1443-bdf1-4ad3-80d2-e7891524bfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48ca1782-73d2-4302-8950-e8eb4a8f9d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:36 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] Volume 6f55351a-3dbe-4cf9-98b1-c0241e316de0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f55351a-3dbe-4cf9-98b1-c0241e316de0', 'volume_size': 1} Sep 01 02:09:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:36 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1505191513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f55351a-3dbe-4cf9-98b1-c0241e316de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c9ee8aeebe4d74a77387ece6d1c22c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:36Z,use_quota=True,user_id='5f659abcc96c4f38a25e8d7f21f3f1eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:36 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] Creating volume 6f55351a-3dbe-4cf9-98b1-c0241e316de0 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:36 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:36 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:36 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:36 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:09:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6f55351a-3dbe-4cf9-98b1-c0241e316de0 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:36 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6f55351a-3dbe-4cf9-98b1-c0241e316de0 1073741824 Sep 01 02:09:36 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:37 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6f55351a-3dbe-4cf9-98b1-c0241e316de0 1073741824" returned: 0 in 0.628s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6f55351a-3dbe-4cf9-98b1-c0241e316de0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:37 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6f55351a-3dbe-4cf9-98b1-c0241e316de0 Sep 01 02:09:37 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:37 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6f55351a-3dbe-4cf9-98b1-c0241e316de0" returned: 0 in 0.364s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:37 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48ca1782-73d2-4302-8950-e8eb4a8f9d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f55351a-3dbe-4cf9-98b1-c0241e316de0', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca5e5b9-dca5-4019-bf94-410c2313f3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:37 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] Volume volume-6f55351a-3dbe-4cf9-98b1-c0241e316de0 (6f55351a-3dbe-4cf9-98b1-c0241e316de0): created successfully Sep 01 02:09:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca5e5b9-dca5-4019-bf94-410c2313f3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] Flow 'volume_create_manager' (2584bae5-6981-47e8-a9d9-7f39941e8d3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:37 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-5ce96dd8-0011-46e0-ab50-32825ef1e74c tempest-VolumesActionsTest-420180064 None] Created volume successfully. Sep 01 02:09:38 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0f050b98-d348-473a-9607-e84205a30dc8 tempest-VolumesActionsTest-1351940805 None] Acquiring lock "cinder-6f55351a-3dbe-4cf9-98b1-c0241e316de0-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:38 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0f050b98-d348-473a-9607-e84205a30dc8 tempest-VolumesActionsTest-1351940805 None] Lock "cinder-6f55351a-3dbe-4cf9-98b1-c0241e316de0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:38 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0f050b98-d348-473a-9607-e84205a30dc8 tempest-VolumesActionsTest-1351940805 None] Acquiring lock "cinder-quobyte-6f55351a-3dbe-4cf9-98b1-c0241e316de0" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:38 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0f050b98-d348-473a-9607-e84205a30dc8 tempest-VolumesActionsTest-1351940805 None] Lock "cinder-quobyte-6f55351a-3dbe-4cf9-98b1-c0241e316de0" acquired by "delete_volume" :: waited 0.032s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:39 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[683f75e4-0f83-4a2f-9e7d-e9482fb023c4]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0f050b98-d348-473a-9607-e84205a30dc8 tempest-VolumesActionsTest-1351940805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6f55351a-3dbe-4cf9-98b1-c0241e316de0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:39 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Flow 'volume_create_manager' (789261ee-ecbf-4c1b-89c8-65006e6a41a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3645382e-8844-42ed-ac63-cd675bdaee0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3645382e-8844-42ed-ac63-cd675bdaee0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b59581c-296f-4f54-8667-a8b1a10a368e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a416dae0967462880fb0c45805e5480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:39Z,use_quota=True,user_id='b5e3e55e533d4749b9dffd458b5c90dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a1b3f30-fc9e-4712-ae73-b0b12be35457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a1b3f30-fc9e-4712-ae73-b0b12be35457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ae2d089-cbe0-42be-b2d7-0099b8ac0d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:39 devstack cinder-volume[87128]: DEBUG cinder.image.glance [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Creating Keystone auth plugin from conf {{(pid=87128) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:09:39 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6f55351a-3dbe-4cf9-98b1-c0241e316de0 Sep 01 02:09:39 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ae2d089-cbe0-42be-b2d7-0099b8ac0d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1b59581c-296f-4f54-8667-a8b1a10a368e', 'volume_name': 'volume-1b59581c-296f-4f54-8667-a8b1a10a368e', 'volume_size': 1, 'image_id': '7b85d3bf-613b-4715-98dd-8dc93bf7eccc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b85d3bf-613b-4715-98dd-8dc93bf7eccc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6052d82c94f318932235e8db0bec23e9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5a416dae0967462880fb0c45805e5480', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a097ce4b6902d0f9351d23e7e58a7dd60e7b806f60d6f03c51ba7f709b979b4aaaa1fa942d3a4ec7b5bafb543d94420b6aa20bd3b1abfa50cb246f5eaaf3b7bf', 'id': '7b85d3bf-613b-4715-98dd-8dc93bf7eccc', 'created_at': datetime.datetime(2026, 9, 1, 0, 9, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 9, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b85d3bf-613b-4715-98dd-8dc93bf7eccc/file', 'properties': {}}, 'image_service': }' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e4aa2e5-6a96-490e-b2ca-52459810a87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e4aa2e5-6a96-490e-b2ca-52459810a87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337600bf-b995-4b14-aa45-da4ef4c88077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:39 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Volume 1b59581c-296f-4f54-8667-a8b1a10a368e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1b59581c-296f-4f54-8667-a8b1a10a368e', 'volume_size': 1, 'image_id': '7b85d3bf-613b-4715-98dd-8dc93bf7eccc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b85d3bf-613b-4715-98dd-8dc93bf7eccc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6052d82c94f318932235e8db0bec23e9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5a416dae0967462880fb0c45805e5480', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a097ce4b6902d0f9351d23e7e58a7dd60e7b806f60d6f03c51ba7f709b979b4aaaa1fa942d3a4ec7b5bafb543d94420b6aa20bd3b1abfa50cb246f5eaaf3b7bf', 'id': '7b85d3bf-613b-4715-98dd-8dc93bf7eccc', 'created_at': datetime.datetime(2026, 9, 1, 0, 9, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 9, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b85d3bf-613b-4715-98dd-8dc93bf7eccc/file', 'properties': {}}, 'image_service': } Sep 01 02:09:39 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Trying to clone 1b59581c-296f-4f54-8667-a8b1a10a368e from image 7b85d3bf-613b-4715-98dd-8dc93bf7eccc at location (None, [{'url': 'file:///opt/stack/data/glance/images/7b85d3bf-613b-4715-98dd-8dc93bf7eccc', 'metadata': {}}]). {{(pid=87128) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:09:39 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0f050b98-d348-473a-9607-e84205a30dc8 tempest-VolumesActionsTest-1351940805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6f55351a-3dbe-4cf9-98b1-c0241e316de0" returned: 0 in 0.488s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0f050b98-d348-473a-9607-e84205a30dc8 tempest-VolumesActionsTest-1351940805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6f55351a-3dbe-4cf9-98b1-c0241e316de0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:39 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6f55351a-3dbe-4cf9-98b1-c0241e316de0 Sep 01 02:09:39 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:39 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_i3zgwtb0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87128) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:09:39 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Image download 0.00 MB at 0.00 MB/s Sep 01 02:09:39 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[232382f9-2a10-4da7-bc9a-462653190920]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_i3zgwtb0devstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:39 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0f050b98-d348-473a-9607-e84205a30dc8 tempest-VolumesActionsTest-1351940805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6f55351a-3dbe-4cf9-98b1-c0241e316de0" returned: 0 in 0.392s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:39 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0f050b98-d348-473a-9607-e84205a30dc8 tempest-VolumesActionsTest-1351940805 None] Lock "cinder-quobyte-6f55351a-3dbe-4cf9-98b1-c0241e316de0" released by "delete_volume" :: held 0.946s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:39 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_i3zgwtb0devstack@QuobyteHD Sep 01 02:09:39 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:40 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-0f050b98-d348-473a-9607-e84205a30dc8 tempest-VolumesActionsTest-1351940805 None] Created reservations ['78933088-7a96-45d4-9103-1afe991f29a4', '90abaa17-b977-4376-9ee3-79e4bfddd955', '1f22b026-f20b-41f8-948a-6fd4d9cad39d', '35bffc96-f04e-41bc-b273-e6ea47f470e8'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0f050b98-d348-473a-9607-e84205a30dc8 tempest-VolumesActionsTest-1351940805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0f050b98-d348-473a-9607-e84205a30dc8 tempest-VolumesActionsTest-1351940805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:40 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0f050b98-d348-473a-9607-e84205a30dc8 tempest-VolumesActionsTest-1351940805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:40 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0f050b98-d348-473a-9607-e84205a30dc8 tempest-VolumesActionsTest-1351940805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0f050b98-d348-473a-9607-e84205a30dc8 tempest-VolumesActionsTest-1351940805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0f050b98-d348-473a-9607-e84205a30dc8 tempest-VolumesActionsTest-1351940805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:40 devstack sudo[100580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:09:40 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:40 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_i3zgwtb0devstack@QuobyteHD" returned: 0 in 0.438s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_i3zgwtb0devstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:40 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_i3zgwtb0devstack@QuobyteHD Sep 01 02:09:40 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:40 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0f050b98-d348-473a-9607-e84205a30dc8 tempest-VolumesActionsTest-1351940805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.292s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:40 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-0f050b98-d348-473a-9607-e84205a30dc8 tempest-VolumesActionsTest-1351940805 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:40 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-0f050b98-d348-473a-9607-e84205a30dc8 tempest-VolumesActionsTest-1351940805 None] Deleted volume successfully. Sep 01 02:09:40 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0f050b98-d348-473a-9607-e84205a30dc8 tempest-VolumesActionsTest-1351940805 None] Lock "cinder-6f55351a-3dbe-4cf9-98b1-c0241e316de0-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:40 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_i3zgwtb0devstack@QuobyteHD" returned: 1 in 0.399s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_i3zgwtb0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:09:40 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Temporary image 7b85d3bf-613b-4715-98dd-8dc93bf7eccc is fetched for user b5e3e55e533d4749b9dffd458b5c90dc. {{(pid=87128) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:09:40 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60a20fb-e013-4d83-bc1d-40756adc1f14]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_i3zgwtb0devstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:40 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_i3zgwtb0devstack@QuobyteHD Sep 01 02:09:40 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:41 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_i3zgwtb0devstack@QuobyteHD" returned: 0 in 0.374s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_i3zgwtb0devstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:41 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_i3zgwtb0devstack@QuobyteHD Sep 01 02:09:41 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:41 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_i3zgwtb0devstack@QuobyteHD" returned: 1 in 0.434s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_i3zgwtb0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:09:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b59581c-296f-4f54-8667-a8b1a10a368e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a416dae0967462880fb0c45805e5480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:39Z,use_quota=True,user_id='b5e3e55e533d4749b9dffd458b5c90dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Creating volume 1b59581c-296f-4f54-8667-a8b1a10a368e {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:41 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:09:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1b59581c-296f-4f54-8667-a8b1a10a368e 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:41 devstack sudo[100612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1b59581c-296f-4f54-8667-a8b1a10a368e 1073741824 Sep 01 02:09:41 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:41 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] Flow 'volume_create_manager' (416f6333-5968-47e0-814d-cbeb178830b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f8d93c-da1a-4eda-a5ae-aea52a7dc303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f8d93c-da1a-4eda-a5ae-aea52a7dc303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1704295185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5d459a4-ae4d-44d0-b557-03dbabf70f3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c9ee8aeebe4d74a77387ece6d1c22c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:42Z,use_quota=True,user_id='5f659abcc96c4f38a25e8d7f21f3f1eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cc4a35d-09ea-4faa-ab61-de737d02d732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cc4a35d-09ea-4faa-ab61-de737d02d732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78092c7d-c52c-4e6d-84a4-1abec4aa41ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78092c7d-c52c-4e6d-84a4-1abec4aa41ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5d459a4-ae4d-44d0-b557-03dbabf70f3a', 'volume_name': 'volume-c5d459a4-ae4d-44d0-b557-03dbabf70f3a', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f3a7525-79c6-4b0c-9ff3-fa8c56aa48e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f3a7525-79c6-4b0c-9ff3-fa8c56aa48e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb5b996-59a0-4e56-a511-b09e2016781d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:42 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] Volume c5d459a4-ae4d-44d0-b557-03dbabf70f3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5d459a4-ae4d-44d0-b557-03dbabf70f3a', 'volume_size': 1} Sep 01 02:09:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:42 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1b59581c-296f-4f54-8667-a8b1a10a368e 1073741824" returned: 0 in 0.840s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1b59581c-296f-4f54-8667-a8b1a10a368e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:42 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1b59581c-296f-4f54-8667-a8b1a10a368e Sep 01 02:09:42 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:42 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1b59581c-296f-4f54-8667-a8b1a10a368e" returned: 0 in 0.364s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.710s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1704295185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5d459a4-ae4d-44d0-b557-03dbabf70f3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c9ee8aeebe4d74a77387ece6d1c22c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:42Z,use_quota=True,user_id='5f659abcc96c4f38a25e8d7f21f3f1eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] Creating volume c5d459a4-ae4d-44d0-b557-03dbabf70f3a {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:42 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:09:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c5d459a4-ae4d-44d0-b557-03dbabf70f3a 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:42 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c5d459a4-ae4d-44d0-b557-03dbabf70f3a 1073741824 Sep 01 02:09:42 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:42 devstack cinder-volume[87128]: DEBUG cinder.volume.volume_utils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Attempting download of 7b85d3bf-613b-4715-98dd-8dc93bf7eccc ((None, [{'url': 'file:///opt/stack/data/glance/images/7b85d3bf-613b-4715-98dd-8dc93bf7eccc', 'metadata': {}}])) to volume 1b59581c-296f-4f54-8667-a8b1a10a368e. {{(pid=87128) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:09:42 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[6faaf773-b707-4fb5-9275-bb580f7b3526]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_any49vhi {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:43 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_any49vhi Sep 01 02:09:43 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:43 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_any49vhi" returned: 0 in 0.381s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_any49vhi {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:43 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c5d459a4-ae4d-44d0-b557-03dbabf70f3a 1073741824" returned: 0 in 0.586s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:43 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_any49vhi Sep 01 02:09:43 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c5d459a4-ae4d-44d0-b557-03dbabf70f3a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:43 devstack sudo[100634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c5d459a4-ae4d-44d0-b557-03dbabf70f3a Sep 01 02:09:43 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:43 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_any49vhi" returned: 1 in 0.405s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_any49vhi' failed. Not Retrying. {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:09:43 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09e7263-e228-464b-9e2a-061eafac2082]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_i3zgwtb0devstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:43 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c5d459a4-ae4d-44d0-b557-03dbabf70f3a" returned: 0 in 0.319s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:43 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb5b996-59a0-4e56-a511-b09e2016781d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5d459a4-ae4d-44d0-b557-03dbabf70f3a', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (722f0ccb-5bfd-4307-a431-fa4bbd7dd3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:43 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] Volume volume-c5d459a4-ae4d-44d0-b557-03dbabf70f3a (c5d459a4-ae4d-44d0-b557-03dbabf70f3a): created successfully Sep 01 02:09:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (722f0ccb-5bfd-4307-a431-fa4bbd7dd3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] Flow 'volume_create_manager' (416f6333-5968-47e0-814d-cbeb178830b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:43 devstack sudo[100639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_i3zgwtb0devstack@QuobyteHD Sep 01 02:09:43 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:43 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-070aa0d7-810c-49f6-a792-7bd5b4a34d00 tempest-VolumesActionsTest-420180064 None] Created volume successfully. Sep 01 02:09:44 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_i3zgwtb0devstack@QuobyteHD" returned: 0 in 0.373s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_i3zgwtb0devstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:44 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c6be3d29-b6b5-44a9-a6e6-fc9d65610bd1 tempest-VolumesActionsTest-1351940805 None] Acquiring lock "cinder-c5d459a4-ae4d-44d0-b557-03dbabf70f3a-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:44 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c6be3d29-b6b5-44a9-a6e6-fc9d65610bd1 tempest-VolumesActionsTest-1351940805 None] Lock "cinder-c5d459a4-ae4d-44d0-b557-03dbabf70f3a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:44 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_i3zgwtb0devstack@QuobyteHD Sep 01 02:09:44 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:44 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c6be3d29-b6b5-44a9-a6e6-fc9d65610bd1 tempest-VolumesActionsTest-1351940805 None] Acquiring lock "cinder-quobyte-c5d459a4-ae4d-44d0-b557-03dbabf70f3a" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:44 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c6be3d29-b6b5-44a9-a6e6-fc9d65610bd1 tempest-VolumesActionsTest-1351940805 None] Lock "cinder-quobyte-c5d459a4-ae4d-44d0-b557-03dbabf70f3a" acquired by "delete_volume" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:44 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd74168-e408-400c-8ce5-434c3d83ef1c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c6be3d29-b6b5-44a9-a6e6-fc9d65610bd1 tempest-VolumesActionsTest-1351940805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c5d459a4-ae4d-44d0-b557-03dbabf70f3a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:44 devstack sudo[100645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c5d459a4-ae4d-44d0-b557-03dbabf70f3a Sep 01 02:09:44 devstack sudo[100645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:44 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_i3zgwtb0devstack@QuobyteHD" returned: 1 in 0.392s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_i3zgwtb0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:09:44 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] 7b85d3bf-613b-4715-98dd-8dc93bf7eccc was raw, converting to qcow2 {{(pid=87128) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:09:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_i3zgwtb0devstack@QuobyteHD /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1b59581c-296f-4f54-8667-a8b1a10a368e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:44 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_i3zgwtb0devstack@QuobyteHD /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1b59581c-296f-4f54-8667-a8b1a10a368e Sep 01 02:09:44 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:44 devstack sudo[100645]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c6be3d29-b6b5-44a9-a6e6-fc9d65610bd1 tempest-VolumesActionsTest-1351940805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c5d459a4-ae4d-44d0-b557-03dbabf70f3a" returned: 0 in 0.451s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c6be3d29-b6b5-44a9-a6e6-fc9d65610bd1 tempest-VolumesActionsTest-1351940805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c5d459a4-ae4d-44d0-b557-03dbabf70f3a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:44 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c5d459a4-ae4d-44d0-b557-03dbabf70f3a Sep 01 02:09:44 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:45 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_i3zgwtb0devstack@QuobyteHD /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1b59581c-296f-4f54-8667-a8b1a10a368e" returned: 0 in 0.528s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:45 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7b85d3bf-613b-4715-98dd-8dc93bf7eccc_i3zgwtb0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1b59581c-296f-4f54-8667-a8b1a10a368e {{(pid=87128) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:09:45 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 02:09:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1b59581c-296f-4f54-8667-a8b1a10a368e 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:45 devstack sudo[100662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1b59581c-296f-4f54-8667-a8b1a10a368e 1G Sep 01 02:09:45 devstack sudo[100662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:45 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c6be3d29-b6b5-44a9-a6e6-fc9d65610bd1 tempest-VolumesActionsTest-1351940805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c5d459a4-ae4d-44d0-b557-03dbabf70f3a" returned: 0 in 0.293s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:45 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c6be3d29-b6b5-44a9-a6e6-fc9d65610bd1 tempest-VolumesActionsTest-1351940805 None] Lock "cinder-quobyte-c5d459a4-ae4d-44d0-b557-03dbabf70f3a" released by "delete_volume" :: held 0.797s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:45 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-c6be3d29-b6b5-44a9-a6e6-fc9d65610bd1 tempest-VolumesActionsTest-1351940805 None] Created reservations ['f03c0e79-fd64-4e6c-a72a-664062a2684e', 'f808a7aa-55a6-4ba2-9d3d-c86a48c72f29', 'e338c7c3-aea7-4433-bcb4-298f00a203ac', '25bfd4e2-b70d-4fed-8e70-63d369ac4afb'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c6be3d29-b6b5-44a9-a6e6-fc9d65610bd1 tempest-VolumesActionsTest-1351940805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c6be3d29-b6b5-44a9-a6e6-fc9d65610bd1 tempest-VolumesActionsTest-1351940805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:45 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c6be3d29-b6b5-44a9-a6e6-fc9d65610bd1 tempest-VolumesActionsTest-1351940805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:45 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c6be3d29-b6b5-44a9-a6e6-fc9d65610bd1 tempest-VolumesActionsTest-1351940805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c6be3d29-b6b5-44a9-a6e6-fc9d65610bd1 tempest-VolumesActionsTest-1351940805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c6be3d29-b6b5-44a9-a6e6-fc9d65610bd1 tempest-VolumesActionsTest-1351940805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:45 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:09:45 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:45 devstack sudo[100662]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1b59581c-296f-4f54-8667-a8b1a10a368e 1G" returned: 0 in 0.418s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:45 devstack cinder-volume[87128]: DEBUG cinder.volume.volume_utils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Downloaded image 7b85d3bf-613b-4715-98dd-8dc93bf7eccc ((None, [{'url': 'file:///opt/stack/data/glance/images/7b85d3bf-613b-4715-98dd-8dc93bf7eccc', 'metadata': {}}])) to volume 1b59581c-296f-4f54-8667-a8b1a10a368e successfully. {{(pid=87128) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:09:45 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Temporary image 7b85d3bf-613b-4715-98dd-8dc93bf7eccc for user b5e3e55e533d4749b9dffd458b5c90dc is deleted. {{(pid=87128) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:09:45 devstack cinder-volume[87128]: DEBUG cinder.volume.volume_utils [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Marking volume 1b59581c-296f-4f54-8667-a8b1a10a368e as bootable. {{(pid=87128) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:09:45 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Copying metadata from image 7b85d3bf-613b-4715-98dd-8dc93bf7eccc to 1b59581c-296f-4f54-8667-a8b1a10a368e. {{(pid=87128) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:09:45 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Creating volume glance metadata for volume 1b59581c-296f-4f54-8667-a8b1a10a368e backed by image 7b85d3bf-613b-4715-98dd-8dc93bf7eccc with: {'image_id': '7b85d3bf-613b-4715-98dd-8dc93bf7eccc', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6052d82c94f318932235e8db0bec23e9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87128) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:09:45 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c6be3d29-b6b5-44a9-a6e6-fc9d65610bd1 tempest-VolumesActionsTest-1351940805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.324s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:45 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-c6be3d29-b6b5-44a9-a6e6-fc9d65610bd1 tempest-VolumesActionsTest-1351940805 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:45 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-c6be3d29-b6b5-44a9-a6e6-fc9d65610bd1 tempest-VolumesActionsTest-1351940805 None] Deleted volume successfully. Sep 01 02:09:45 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337600bf-b995-4b14-aa45-da4ef4c88077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b59581c-296f-4f54-8667-a8b1a10a368e', 'volume_size': 1, 'image_id': '7b85d3bf-613b-4715-98dd-8dc93bf7eccc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b85d3bf-613b-4715-98dd-8dc93bf7eccc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6052d82c94f318932235e8db0bec23e9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5a416dae0967462880fb0c45805e5480', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a097ce4b6902d0f9351d23e7e58a7dd60e7b806f60d6f03c51ba7f709b979b4aaaa1fa942d3a4ec7b5bafb543d94420b6aa20bd3b1abfa50cb246f5eaaf3b7bf', 'id': '7b85d3bf-613b-4715-98dd-8dc93bf7eccc', 'created_at': datetime.datetime(2026, 9, 1, 0, 9, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 9, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b85d3bf-613b-4715-98dd-8dc93bf7eccc/file', 'properties': {}}, 'image_service': }' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:45 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec8e5af-732c-4320-a763-5fe507918c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:45 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c6be3d29-b6b5-44a9-a6e6-fc9d65610bd1 tempest-VolumesActionsTest-1351940805 None] Lock "cinder-c5d459a4-ae4d-44d0-b557-03dbabf70f3a-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:45 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Volume volume-1b59581c-296f-4f54-8667-a8b1a10a368e (1b59581c-296f-4f54-8667-a8b1a10a368e): created successfully Sep 01 02:09:45 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec8e5af-732c-4320-a763-5fe507918c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:45 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Flow 'volume_create_manager' (789261ee-ecbf-4c1b-89c8-65006e6a41a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:45 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-3bc4c98d-8ac8-4132-84f2-b16207095ff9 tempest-VolumeImageDependencyTests-1417564475 None] Created volume successfully. Sep 01 02:09:46 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] Flow 'volume_create_manager' (58cdc661-35de-4bf1-998f-fc38b37364c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef07d7d-10d4-432e-999b-c2e10a39c34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef07d7d-10d4-432e-999b-c2e10a39c34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1114302429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ed1523-3e54-4828-9a64-61366cb03cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c9ee8aeebe4d74a77387ece6d1c22c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:46Z,use_quota=True,user_id='5f659abcc96c4f38a25e8d7f21f3f1eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a499b146-a011-4136-9754-36788685d999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a499b146-a011-4136-9754-36788685d999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (766edf8a-b3ce-4323-bd1e-21673a567edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (766edf8a-b3ce-4323-bd1e-21673a567edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6ed1523-3e54-4828-9a64-61366cb03cca', 'volume_name': 'volume-c6ed1523-3e54-4828-9a64-61366cb03cca', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8fc1b1b-024a-4966-beb1-d4aaa0dd7598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8fc1b1b-024a-4966-beb1-d4aaa0dd7598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5632d93-86f2-4600-bfff-d109d2e0a0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:46 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] Volume c6ed1523-3e54-4828-9a64-61366cb03cca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6ed1523-3e54-4828-9a64-61366cb03cca', 'volume_size': 1} Sep 01 02:09:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1114302429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ed1523-3e54-4828-9a64-61366cb03cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c9ee8aeebe4d74a77387ece6d1c22c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:46Z,use_quota=True,user_id='5f659abcc96c4f38a25e8d7f21f3f1eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] Creating volume c6ed1523-3e54-4828-9a64-61366cb03cca {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:46 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:09:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c6ed1523-3e54-4828-9a64-61366cb03cca 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:46 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c6ed1523-3e54-4828-9a64-61366cb03cca 1073741824 Sep 01 02:09:46 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-16ad3f76-042f-48ae-a69c-f25d85375ead tempest-VolumeImageDependencyTests-1417564475 None] Acquiring lock "cinder-1b59581c-296f-4f54-8667-a8b1a10a368e-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-16ad3f76-042f-48ae-a69c-f25d85375ead tempest-VolumeImageDependencyTests-1417564475 None] Lock "cinder-1b59581c-296f-4f54-8667-a8b1a10a368e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-16ad3f76-042f-48ae-a69c-f25d85375ead tempest-VolumeImageDependencyTests-1417564475 None] Acquiring lock "cinder-quobyte-1b59581c-296f-4f54-8667-a8b1a10a368e" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-16ad3f76-042f-48ae-a69c-f25d85375ead tempest-VolumeImageDependencyTests-1417564475 None] Lock "cinder-quobyte-1b59581c-296f-4f54-8667-a8b1a10a368e" acquired by "delete_volume" :: waited 0.021s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:46 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d25d0cd-38e7-4901-a5ba-7009013f0505]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-16ad3f76-042f-48ae-a69c-f25d85375ead tempest-VolumeImageDependencyTests-1417564475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1b59581c-296f-4f54-8667-a8b1a10a368e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:46 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c6ed1523-3e54-4828-9a64-61366cb03cca 1073741824" returned: 0 in 0.587s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c6ed1523-3e54-4828-9a64-61366cb03cca {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:46 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c6ed1523-3e54-4828-9a64-61366cb03cca Sep 01 02:09:46 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:46 devstack sudo[100676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1b59581c-296f-4f54-8667-a8b1a10a368e Sep 01 02:09:46 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:47 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c6ed1523-3e54-4828-9a64-61366cb03cca" returned: 0 in 0.281s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:47 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5632d93-86f2-4600-bfff-d109d2e0a0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6ed1523-3e54-4828-9a64-61366cb03cca', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd0eee56-1017-4665-9557-1d629d5b75ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:47 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] Volume volume-c6ed1523-3e54-4828-9a64-61366cb03cca (c6ed1523-3e54-4828-9a64-61366cb03cca): created successfully Sep 01 02:09:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd0eee56-1017-4665-9557-1d629d5b75ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] Flow 'volume_create_manager' (58cdc661-35de-4bf1-998f-fc38b37364c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:47 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:47 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-7d0cb793-6530-4397-b669-7e68e17b4e6d tempest-VolumesActionsTest-420180064 None] Created volume successfully. Sep 01 02:09:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-16ad3f76-042f-48ae-a69c-f25d85375ead tempest-VolumeImageDependencyTests-1417564475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1b59581c-296f-4f54-8667-a8b1a10a368e" returned: 0 in 0.425s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-16ad3f76-042f-48ae-a69c-f25d85375ead tempest-VolumeImageDependencyTests-1417564475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1b59581c-296f-4f54-8667-a8b1a10a368e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:47 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1b59581c-296f-4f54-8667-a8b1a10a368e Sep 01 02:09:47 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:47 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-16ad3f76-042f-48ae-a69c-f25d85375ead tempest-VolumeImageDependencyTests-1417564475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1b59581c-296f-4f54-8667-a8b1a10a368e" returned: 0 in 0.297s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:47 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-16ad3f76-042f-48ae-a69c-f25d85375ead tempest-VolumeImageDependencyTests-1417564475 None] Lock "cinder-quobyte-1b59581c-296f-4f54-8667-a8b1a10a368e" released by "delete_volume" :: held 0.771s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:47 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-16ad3f76-042f-48ae-a69c-f25d85375ead tempest-VolumeImageDependencyTests-1417564475 None] Created reservations ['84e206de-3f5f-40bf-91a7-b7e9d2aad692', '5a1b3b8b-0c72-45c2-8b16-292ca9f9f243', '6974054e-ecba-4b8f-a60d-5021dabffeb2', 'e09b6e45-1015-4892-ae63-e6848db7d542'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-16ad3f76-042f-48ae-a69c-f25d85375ead tempest-VolumeImageDependencyTests-1417564475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-16ad3f76-042f-48ae-a69c-f25d85375ead tempest-VolumeImageDependencyTests-1417564475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:47 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-16ad3f76-042f-48ae-a69c-f25d85375ead tempest-VolumeImageDependencyTests-1417564475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:47 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-16ad3f76-042f-48ae-a69c-f25d85375ead tempest-VolumeImageDependencyTests-1417564475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-16ad3f76-042f-48ae-a69c-f25d85375ead tempest-VolumeImageDependencyTests-1417564475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-16ad3f76-042f-48ae-a69c-f25d85375ead tempest-VolumeImageDependencyTests-1417564475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:47 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:09:47 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:47 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-16ad3f76-042f-48ae-a69c-f25d85375ead tempest-VolumeImageDependencyTests-1417564475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.300s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:47 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-16ad3f76-042f-48ae-a69c-f25d85375ead tempest-VolumeImageDependencyTests-1417564475 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:47 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-16ad3f76-042f-48ae-a69c-f25d85375ead tempest-VolumeImageDependencyTests-1417564475 None] Deleted volume successfully. Sep 01 02:09:47 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-16ad3f76-042f-48ae-a69c-f25d85375ead tempest-VolumeImageDependencyTests-1417564475 None] Lock "cinder-1b59581c-296f-4f54-8667-a8b1a10a368e-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-adbfb3be-2802-4cb2-94f5-8c4c4599132d tempest-VolumesActionsTest-420180064 None] Acquiring lock "cinder-c6ed1523-3e54-4828-9a64-61366cb03cca-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-adbfb3be-2802-4cb2-94f5-8c4c4599132d tempest-VolumesActionsTest-420180064 None] Lock "cinder-c6ed1523-3e54-4828-9a64-61366cb03cca-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-adbfb3be-2802-4cb2-94f5-8c4c4599132d tempest-VolumesActionsTest-420180064 None] Acquiring lock "cinder-quobyte-c6ed1523-3e54-4828-9a64-61366cb03cca" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-adbfb3be-2802-4cb2-94f5-8c4c4599132d tempest-VolumesActionsTest-420180064 None] Lock "cinder-quobyte-c6ed1523-3e54-4828-9a64-61366cb03cca" acquired by "delete_volume" :: waited 0.020s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:49 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa95798-ef69-4919-a641-a1be15c03ed6]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-adbfb3be-2802-4cb2-94f5-8c4c4599132d tempest-VolumesActionsTest-420180064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c6ed1523-3e54-4828-9a64-61366cb03cca {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:49 devstack sudo[100690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c6ed1523-3e54-4828-9a64-61366cb03cca Sep 01 02:09:49 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:49 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-adbfb3be-2802-4cb2-94f5-8c4c4599132d tempest-VolumesActionsTest-420180064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c6ed1523-3e54-4828-9a64-61366cb03cca" returned: 0 in 0.495s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-adbfb3be-2802-4cb2-94f5-8c4c4599132d tempest-VolumesActionsTest-420180064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c6ed1523-3e54-4828-9a64-61366cb03cca {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:49 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c6ed1523-3e54-4828-9a64-61366cb03cca Sep 01 02:09:49 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:49 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-adbfb3be-2802-4cb2-94f5-8c4c4599132d tempest-VolumesActionsTest-420180064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c6ed1523-3e54-4828-9a64-61366cb03cca" returned: 0 in 0.274s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-adbfb3be-2802-4cb2-94f5-8c4c4599132d tempest-VolumesActionsTest-420180064 None] Lock "cinder-quobyte-c6ed1523-3e54-4828-9a64-61366cb03cca" released by "delete_volume" :: held 0.828s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:49 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-adbfb3be-2802-4cb2-94f5-8c4c4599132d tempest-VolumesActionsTest-420180064 None] Created reservations ['ce0daf1e-0e6c-435f-9dc6-d71e38eebf87', 'cfbf0aa1-476f-424d-8e38-3fc80e375889', '9806165c-cf1a-4b81-94e8-b3c2c3ba0814', '10498783-6314-4bbe-beba-00781aa9709c'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-adbfb3be-2802-4cb2-94f5-8c4c4599132d tempest-VolumesActionsTest-420180064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-adbfb3be-2802-4cb2-94f5-8c4c4599132d tempest-VolumesActionsTest-420180064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:50 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-adbfb3be-2802-4cb2-94f5-8c4c4599132d tempest-VolumesActionsTest-420180064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:50 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-adbfb3be-2802-4cb2-94f5-8c4c4599132d tempest-VolumesActionsTest-420180064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-adbfb3be-2802-4cb2-94f5-8c4c4599132d tempest-VolumesActionsTest-420180064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-adbfb3be-2802-4cb2-94f5-8c4c4599132d tempest-VolumesActionsTest-420180064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:50 devstack sudo[100698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:09:50 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:50 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-adbfb3be-2802-4cb2-94f5-8c4c4599132d tempest-VolumesActionsTest-420180064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.339s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:50 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-adbfb3be-2802-4cb2-94f5-8c4c4599132d tempest-VolumesActionsTest-420180064 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:50 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-adbfb3be-2802-4cb2-94f5-8c4c4599132d tempest-VolumesActionsTest-420180064 None] Deleted volume successfully. Sep 01 02:09:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-adbfb3be-2802-4cb2-94f5-8c4c4599132d tempest-VolumesActionsTest-420180064 None] Lock "cinder-c6ed1523-3e54-4828-9a64-61366cb03cca-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:53 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:53 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] Flow 'volume_create_manager' (de11a303-5727-4299-a9a2-f269c3dd8b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:53 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d19f5244-6a30-4d03-a693-cd5d1d9b6834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:53 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d19f5244-6a30-4d03-a693-cd5d1d9b6834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1021676768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3861a405-c8bb-4a73-affb-e1fc8eacf98a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a161f4a260c64c15a7db86a4974f4d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:53Z,use_quota=True,user_id='cdebc9923f1b4fc9bf45912f160e83e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:53 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c89c0071-97d2-42e2-a751-684b15c165b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:53 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c89c0071-97d2-42e2-a751-684b15c165b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:53 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a615f8f-25c6-451f-8fa3-31e05ff4dad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:53 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a615f8f-25c6-451f-8fa3-31e05ff4dad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3861a405-c8bb-4a73-affb-e1fc8eacf98a', 'volume_name': 'volume-3861a405-c8bb-4a73-affb-e1fc8eacf98a', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:53 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e32a65f-a4d4-480b-8e43-320c973c21b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:53 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e32a65f-a4d4-480b-8e43-320c973c21b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:53 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8de094-4cee-4f16-af56-809eaa9bc1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:53 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] Volume 3861a405-c8bb-4a73-affb-e1fc8eacf98a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3861a405-c8bb-4a73-affb-e1fc8eacf98a', 'volume_size': 1} Sep 01 02:09:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1021676768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3861a405-c8bb-4a73-affb-e1fc8eacf98a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a161f4a260c64c15a7db86a4974f4d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:53Z,use_quota=True,user_id='cdebc9923f1b4fc9bf45912f160e83e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] Creating volume 3861a405-c8bb-4a73-affb-e1fc8eacf98a {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:53 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:09:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3861a405-c8bb-4a73-affb-e1fc8eacf98a 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:53 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3861a405-c8bb-4a73-affb-e1fc8eacf98a 1073741824 Sep 01 02:09:53 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:54 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3861a405-c8bb-4a73-affb-e1fc8eacf98a 1073741824" returned: 0 in 0.577s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3861a405-c8bb-4a73-affb-e1fc8eacf98a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:54 devstack sudo[100709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3861a405-c8bb-4a73-affb-e1fc8eacf98a Sep 01 02:09:54 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:54 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3861a405-c8bb-4a73-affb-e1fc8eacf98a" returned: 0 in 0.367s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8de094-4cee-4f16-af56-809eaa9bc1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3861a405-c8bb-4a73-affb-e1fc8eacf98a', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fad9f70d-1199-4948-801b-266ea58d63c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:54 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] Volume volume-3861a405-c8bb-4a73-affb-e1fc8eacf98a (3861a405-c8bb-4a73-affb-e1fc8eacf98a): created successfully Sep 01 02:09:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fad9f70d-1199-4948-801b-266ea58d63c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] Flow 'volume_create_manager' (de11a303-5727-4299-a9a2-f269c3dd8b8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:54 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-e44957c2-9a39-404d-aff5-5b85ad53c8d7 tempest-ProjectReaderTests-738854185 None] Created volume successfully. Sep 01 02:09:55 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c4f5708e-7c31-4fd5-886d-25aaf69791a5 tempest-ProjectReaderTests-738854185 None] Acquiring lock "cinder-3861a405-c8bb-4a73-affb-e1fc8eacf98a-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:55 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c4f5708e-7c31-4fd5-886d-25aaf69791a5 tempest-ProjectReaderTests-738854185 None] Lock "cinder-3861a405-c8bb-4a73-affb-e1fc8eacf98a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:55 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c4f5708e-7c31-4fd5-886d-25aaf69791a5 tempest-ProjectReaderTests-738854185 None] Acquiring lock "cinder-quobyte-3861a405-c8bb-4a73-affb-e1fc8eacf98a" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:55 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c4f5708e-7c31-4fd5-886d-25aaf69791a5 tempest-ProjectReaderTests-738854185 None] Lock "cinder-quobyte-3861a405-c8bb-4a73-affb-e1fc8eacf98a" acquired by "delete_volume" :: waited 0.015s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:55 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22dc603-b123-47d8-9995-0418862f2797]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4f5708e-7c31-4fd5-886d-25aaf69791a5 tempest-ProjectReaderTests-738854185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3861a405-c8bb-4a73-affb-e1fc8eacf98a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:56 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3861a405-c8bb-4a73-affb-e1fc8eacf98a Sep 01 02:09:56 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:56 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4f5708e-7c31-4fd5-886d-25aaf69791a5 tempest-ProjectReaderTests-738854185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3861a405-c8bb-4a73-affb-e1fc8eacf98a" returned: 0 in 0.573s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4f5708e-7c31-4fd5-886d-25aaf69791a5 tempest-ProjectReaderTests-738854185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3861a405-c8bb-4a73-affb-e1fc8eacf98a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:56 devstack sudo[100727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3861a405-c8bb-4a73-affb-e1fc8eacf98a Sep 01 02:09:56 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:56 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4f5708e-7c31-4fd5-886d-25aaf69791a5 tempest-ProjectReaderTests-738854185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3861a405-c8bb-4a73-affb-e1fc8eacf98a" returned: 0 in 0.370s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:56 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c4f5708e-7c31-4fd5-886d-25aaf69791a5 tempest-ProjectReaderTests-738854185 None] Lock "cinder-quobyte-3861a405-c8bb-4a73-affb-e1fc8eacf98a" released by "delete_volume" :: held 1.011s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-9203c0cb-30ba-45ec-9609-50ae77556493 req-c9f93394-a4a1-469c-82de-7677b424f224 tempest-TestStampPattern-539610372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-9203c0cb-30ba-45ec-9609-50ae77556493 req-c9f93394-a4a1-469c-82de-7677b424f224 tempest-TestStampPattern-539610372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-9203c0cb-30ba-45ec-9609-50ae77556493 req-c9f93394-a4a1-469c-82de-7677b424f224 tempest-TestStampPattern-539610372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:57 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-c4f5708e-7c31-4fd5-886d-25aaf69791a5 tempest-ProjectReaderTests-738854185 None] Created reservations ['efec79d9-4ff4-4e49-8d2e-5fb8c8f92a95', '35c23e7d-4547-4783-b7ad-4f03c2d909c9', 'ab8a6819-efd0-4c4b-b577-006d334c2c33', 'cef46339-377e-42ce-8dd6-19cc2a4b51d3'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-9203c0cb-30ba-45ec-9609-50ae77556493 req-c9f93394-a4a1-469c-82de-7677b424f224 tempest-TestStampPattern-539610372 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb', 'name': 'volume-c8679077-2240-4ab4-9483-8cd01741e672', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '090d5b52-219e-4903-b8df-418fc410b517', 'enforce_multipath': True} {{(pid=87128) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:09:57 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-9203c0cb-30ba-45ec-9609-50ae77556493 req-c9f93394-a4a1-469c-82de-7677b424f224 tempest-TestStampPattern-539610372 None] attachment_update completed successfully. Sep 01 02:09:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c4f5708e-7c31-4fd5-886d-25aaf69791a5 tempest-ProjectReaderTests-738854185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c4f5708e-7c31-4fd5-886d-25aaf69791a5 tempest-ProjectReaderTests-738854185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c4f5708e-7c31-4fd5-886d-25aaf69791a5 tempest-ProjectReaderTests-738854185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c4f5708e-7c31-4fd5-886d-25aaf69791a5 tempest-ProjectReaderTests-738854185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c4f5708e-7c31-4fd5-886d-25aaf69791a5 tempest-ProjectReaderTests-738854185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4f5708e-7c31-4fd5-886d-25aaf69791a5 tempest-ProjectReaderTests-738854185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:57 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:09:57 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:57 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4f5708e-7c31-4fd5-886d-25aaf69791a5 tempest-ProjectReaderTests-738854185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.411s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:57 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-c4f5708e-7c31-4fd5-886d-25aaf69791a5 tempest-ProjectReaderTests-738854185 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:57 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-c4f5708e-7c31-4fd5-886d-25aaf69791a5 tempest-ProjectReaderTests-738854185 None] Deleted volume successfully. Sep 01 02:09:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c4f5708e-7c31-4fd5-886d-25aaf69791a5 tempest-ProjectReaderTests-738854185 None] Lock "cinder-3861a405-c8bb-4a73-affb-e1fc8eacf98a-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:58 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] Flow 'volume_create_manager' (de388c40-deff-478f-832e-730fc4d52329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb86193e-1f6f-43ae-980d-bb8010adf206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb86193e-1f6f-43ae-980d-bb8010adf206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-278586735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a352c91-3225-4d8e-9b58-de2a2a64f917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a161f4a260c64c15a7db86a4974f4d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:59Z,use_quota=True,user_id='cdebc9923f1b4fc9bf45912f160e83e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c014bae3-6bd1-494f-9458-a625e56d5956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c014bae3-6bd1-494f-9458-a625e56d5956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc500ab1-4537-4728-80fc-572a80f09909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc500ab1-4537-4728-80fc-572a80f09909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a352c91-3225-4d8e-9b58-de2a2a64f917', 'volume_name': 'volume-8a352c91-3225-4d8e-9b58-de2a2a64f917', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6732609-b7e1-450f-8f18-43176aaceefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6732609-b7e1-450f-8f18-43176aaceefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3589a00f-4415-4b13-941a-5958732f75c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:58 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] Volume 8a352c91-3225-4d8e-9b58-de2a2a64f917: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a352c91-3225-4d8e-9b58-de2a2a64f917', 'volume_size': 1} Sep 01 02:09:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-278586735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a352c91-3225-4d8e-9b58-de2a2a64f917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a161f4a260c64c15a7db86a4974f4d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:59Z,use_quota=True,user_id='cdebc9923f1b4fc9bf45912f160e83e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] Creating volume 8a352c91-3225-4d8e-9b58-de2a2a64f917 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:58 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:09:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a352c91-3225-4d8e-9b58-de2a2a64f917 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:58 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a352c91-3225-4d8e-9b58-de2a2a64f917 1073741824 Sep 01 02:09:58 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:59 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a352c91-3225-4d8e-9b58-de2a2a64f917 1073741824" returned: 0 in 0.889s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a352c91-3225-4d8e-9b58-de2a2a64f917 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:59 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a352c91-3225-4d8e-9b58-de2a2a64f917 Sep 01 02:09:59 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:00 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a352c91-3225-4d8e-9b58-de2a2a64f917" returned: 0 in 0.442s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:00 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:10:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3589a00f-4415-4b13-941a-5958732f75c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a352c91-3225-4d8e-9b58-de2a2a64f917', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea6b9de-6df8-42be-9b4c-7b953540be59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:00 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] Volume volume-8a352c91-3225-4d8e-9b58-de2a2a64f917 (8a352c91-3225-4d8e-9b58-de2a2a64f917): created successfully Sep 01 02:10:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea6b9de-6df8-42be-9b4c-7b953540be59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] Flow 'volume_create_manager' (de388c40-deff-478f-832e-730fc4d52329) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:00 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-7915593a-487a-4419-913f-8b9ec390c398 tempest-ProjectReaderTests-738854185 None] Created volume successfully. Sep 01 02:10:01 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c6674c3d-2f13-4dc6-956d-b1776a955f03 tempest-ProjectReaderTests-738854185 None] Acquiring lock "cinder-8a352c91-3225-4d8e-9b58-de2a2a64f917-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:01 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c6674c3d-2f13-4dc6-956d-b1776a955f03 tempest-ProjectReaderTests-738854185 None] Lock "cinder-8a352c91-3225-4d8e-9b58-de2a2a64f917-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:01 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c6674c3d-2f13-4dc6-956d-b1776a955f03 tempest-ProjectReaderTests-738854185 None] Acquiring lock "cinder-quobyte-8a352c91-3225-4d8e-9b58-de2a2a64f917" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:01 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-eebe02f4-6f89-4579-a0d8-1090410a54b7 req-0e74cb1f-6fc7-4351-b952-f52b0251fd67 tempest-TestStampPattern-539610372 None] Terminate volume connection completed successfully. Sep 01 02:10:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-eebe02f4-6f89-4579-a0d8-1090410a54b7 req-0e74cb1f-6fc7-4351-b952-f52b0251fd67 tempest-TestStampPattern-539610372 None] Deleting attachment 090d5b52-219e-4903-b8df-418fc410b517. {{(pid=87128) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:10:01 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c6674c3d-2f13-4dc6-956d-b1776a955f03 tempest-ProjectReaderTests-738854185 None] Lock "cinder-quobyte-8a352c91-3225-4d8e-9b58-de2a2a64f917" acquired by "delete_volume" :: waited 0.031s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:01 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5f0eb2-9665-4eb4-acd4-c82179ce00fc]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c6674c3d-2f13-4dc6-956d-b1776a955f03 tempest-ProjectReaderTests-738854185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a352c91-3225-4d8e-9b58-de2a2a64f917 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:01 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a352c91-3225-4d8e-9b58-de2a2a64f917 Sep 01 02:10:01 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:01 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c6674c3d-2f13-4dc6-956d-b1776a955f03 tempest-ProjectReaderTests-738854185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a352c91-3225-4d8e-9b58-de2a2a64f917" returned: 0 in 0.501s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c6674c3d-2f13-4dc6-956d-b1776a955f03 tempest-ProjectReaderTests-738854185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a352c91-3225-4d8e-9b58-de2a2a64f917 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:01 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a352c91-3225-4d8e-9b58-de2a2a64f917 Sep 01 02:10:01 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:02 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c6674c3d-2f13-4dc6-956d-b1776a955f03 tempest-ProjectReaderTests-738854185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a352c91-3225-4d8e-9b58-de2a2a64f917" returned: 0 in 0.322s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:02 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c6674c3d-2f13-4dc6-956d-b1776a955f03 tempest-ProjectReaderTests-738854185 None] Lock "cinder-quobyte-8a352c91-3225-4d8e-9b58-de2a2a64f917" released by "delete_volume" :: held 0.895s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:02 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-c6674c3d-2f13-4dc6-956d-b1776a955f03 tempest-ProjectReaderTests-738854185 None] Created reservations ['d109be0b-67d7-4752-8bc5-9c4debc41d84', 'd09c87ef-1608-4bb6-b147-070049b7092f', '3874e416-cb74-45aa-a049-04a094207b4b', 'd166cd50-1d2a-4c77-9786-dd0590d2bba8'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c6674c3d-2f13-4dc6-956d-b1776a955f03 tempest-ProjectReaderTests-738854185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c6674c3d-2f13-4dc6-956d-b1776a955f03 tempest-ProjectReaderTests-738854185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c6674c3d-2f13-4dc6-956d-b1776a955f03 tempest-ProjectReaderTests-738854185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c6674c3d-2f13-4dc6-956d-b1776a955f03 tempest-ProjectReaderTests-738854185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c6674c3d-2f13-4dc6-956d-b1776a955f03 tempest-ProjectReaderTests-738854185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c6674c3d-2f13-4dc6-956d-b1776a955f03 tempest-ProjectReaderTests-738854185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:02 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:10:02 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:02 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c6674c3d-2f13-4dc6-956d-b1776a955f03 tempest-ProjectReaderTests-738854185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.530s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:02 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-c6674c3d-2f13-4dc6-956d-b1776a955f03 tempest-ProjectReaderTests-738854185 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:02 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-c6674c3d-2f13-4dc6-956d-b1776a955f03 tempest-ProjectReaderTests-738854185 None] Deleted volume successfully. Sep 01 02:10:03 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c6674c3d-2f13-4dc6-956d-b1776a955f03 tempest-ProjectReaderTests-738854185 None] Lock "cinder-8a352c91-3225-4d8e-9b58-de2a2a64f917-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:08 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-48b39ee0-e158-46e0-b8b2-682816e9f0bf tempest-TestStampPattern-539610372 None] Acquiring lock "cinder-c8679077-2240-4ab4-9483-8cd01741e672-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:08 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-48b39ee0-e158-46e0-b8b2-682816e9f0bf tempest-TestStampPattern-539610372 None] Lock "cinder-c8679077-2240-4ab4-9483-8cd01741e672-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:08 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=141,cinder:UPDATE=196,cinder:INSERT=57,cinder:DELETE=15 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:10:08 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-48b39ee0-e158-46e0-b8b2-682816e9f0bf tempest-TestStampPattern-539610372 None] Acquiring lock "cinder-quobyte-c8679077-2240-4ab4-9483-8cd01741e672" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:08 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-48b39ee0-e158-46e0-b8b2-682816e9f0bf tempest-TestStampPattern-539610372 None] Lock "cinder-quobyte-c8679077-2240-4ab4-9483-8cd01741e672" acquired by "delete_volume" :: waited 0.025s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:08 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[757933cd-d07e-46d3-af13-ca93750ba756]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-48b39ee0-e158-46e0-b8b2-682816e9f0bf tempest-TestStampPattern-539610372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c8679077-2240-4ab4-9483-8cd01741e672 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:08 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c8679077-2240-4ab4-9483-8cd01741e672 Sep 01 02:10:08 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:09 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-48b39ee0-e158-46e0-b8b2-682816e9f0bf tempest-TestStampPattern-539610372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c8679077-2240-4ab4-9483-8cd01741e672" returned: 0 in 0.634s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-48b39ee0-e158-46e0-b8b2-682816e9f0bf tempest-TestStampPattern-539610372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c8679077-2240-4ab4-9483-8cd01741e672 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:09 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c8679077-2240-4ab4-9483-8cd01741e672 Sep 01 02:10:09 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:09 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-48b39ee0-e158-46e0-b8b2-682816e9f0bf tempest-TestStampPattern-539610372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c8679077-2240-4ab4-9483-8cd01741e672" returned: 0 in 0.403s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:09 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-48b39ee0-e158-46e0-b8b2-682816e9f0bf tempest-TestStampPattern-539610372 None] Lock "cinder-quobyte-c8679077-2240-4ab4-9483-8cd01741e672" released by "delete_volume" :: held 1.101s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:09 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-48b39ee0-e158-46e0-b8b2-682816e9f0bf tempest-TestStampPattern-539610372 None] Created reservations ['ba4bcabf-e783-4988-9ec1-2d11723321f3', '4ec62dfd-bfc0-4723-9592-c9ac4f768571', 'f4fdb258-1bbc-4e1e-baac-e1bf9ecb38ec', '981abf05-512b-4091-9cb6-dc78ed50f06f'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-48b39ee0-e158-46e0-b8b2-682816e9f0bf tempest-TestStampPattern-539610372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-48b39ee0-e158-46e0-b8b2-682816e9f0bf tempest-TestStampPattern-539610372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:10 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-48b39ee0-e158-46e0-b8b2-682816e9f0bf tempest-TestStampPattern-539610372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:10 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-48b39ee0-e158-46e0-b8b2-682816e9f0bf tempest-TestStampPattern-539610372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-48b39ee0-e158-46e0-b8b2-682816e9f0bf tempest-TestStampPattern-539610372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-48b39ee0-e158-46e0-b8b2-682816e9f0bf tempest-TestStampPattern-539610372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:10 devstack sudo[101321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:10:10 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:10 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-48b39ee0-e158-46e0-b8b2-682816e9f0bf tempest-TestStampPattern-539610372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.278s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:10 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-48b39ee0-e158-46e0-b8b2-682816e9f0bf tempest-TestStampPattern-539610372 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:10 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-48b39ee0-e158-46e0-b8b2-682816e9f0bf tempest-TestStampPattern-539610372 None] Deleted volume successfully. Sep 01 02:10:10 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-48b39ee0-e158-46e0-b8b2-682816e9f0bf tempest-TestStampPattern-539610372 None] Lock "cinder-c8679077-2240-4ab4-9483-8cd01741e672-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7244e6e4-7e23-4d13-a9cb-39f7ada8b73f tempest-TestStampPattern-539610372 None] Acquiring lock "cinder-0bba738f-5a6b-40ef-b6ba-00a5c4b1700f-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7244e6e4-7e23-4d13-a9cb-39f7ada8b73f tempest-TestStampPattern-539610372 None] Lock "cinder-0bba738f-5a6b-40ef-b6ba-00a5c4b1700f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7244e6e4-7e23-4d13-a9cb-39f7ada8b73f tempest-TestStampPattern-539610372 None] Acquiring lock "cinder-quobyte-eb7a50bd-eb42-44e5-85b6-86df7f66c511" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7244e6e4-7e23-4d13-a9cb-39f7ada8b73f tempest-TestStampPattern-539610372 None] Lock "cinder-quobyte-eb7a50bd-eb42-44e5-85b6-86df7f66c511" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7244e6e4-7e23-4d13-a9cb-39f7ada8b73f tempest-TestStampPattern-539610372 None] Acquiring lock "cinder-quobyte-0bba738f-5a6b-40ef-b6ba-00a5c4b1700f" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7244e6e4-7e23-4d13-a9cb-39f7ada8b73f tempest-TestStampPattern-539610372 None] Lock "cinder-quobyte-0bba738f-5a6b-40ef-b6ba-00a5c4b1700f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:11 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-7244e6e4-7e23-4d13-a9cb-39f7ada8b73f tempest-TestStampPattern-539610372 None] Deleting offline snapshot 0bba738f-5a6b-40ef-b6ba-00a5c4b1700f of volume eb7a50bd-eb42-44e5-85b6-86df7f66c511 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:10:11 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-7244e6e4-7e23-4d13-a9cb-39f7ada8b73f tempest-TestStampPattern-539610372 None] snapshot_file for this snap is: volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511.0bba738f-5a6b-40ef-b6ba-00a5c4b1700f {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:10:11 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[688e6999-1fe3-4211-ab9b-0fa3874bfbe5]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7244e6e4-7e23-4d13-a9cb-39f7ada8b73f tempest-TestStampPattern-539610372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511.0bba738f-5a6b-40ef-b6ba-00a5c4b1700f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:11 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511.0bba738f-5a6b-40ef-b6ba-00a5c4b1700f Sep 01 02:10:11 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:12 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7244e6e4-7e23-4d13-a9cb-39f7ada8b73f tempest-TestStampPattern-539610372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511.0bba738f-5a6b-40ef-b6ba-00a5c4b1700f" returned: 0 in 0.545s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:12 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-7244e6e4-7e23-4d13-a9cb-39f7ada8b73f tempest-TestStampPattern-539610372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:10:12 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[91faae1e-b89f-4af1-864c-08b2cc2e36d5]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7244e6e4-7e23-4d13-a9cb-39f7ada8b73f tempest-TestStampPattern-539610372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:12 devstack sudo[101330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511 Sep 01 02:10:12 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:12 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7244e6e4-7e23-4d13-a9cb-39f7ada8b73f tempest-TestStampPattern-539610372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511" returned: 0 in 0.774s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7244e6e4-7e23-4d13-a9cb-39f7ada8b73f tempest-TestStampPattern-539610372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511.0bba738f-5a6b-40ef-b6ba-00a5c4b1700f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:12 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511.0bba738f-5a6b-40ef-b6ba-00a5c4b1700f Sep 01 02:10:12 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] Flow 'volume_create_manager' (ba6775bd-2918-48e0-96a7-9118d6e3ccc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7eecfce-0d91-4ecb-9868-b710e74dd8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7eecfce-0d91-4ecb-9868-b710e74dd8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-743285628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40237051-cc2c-4447-adaf-e1dc5c924ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='656bf2f907254f56b3b3dc931d1da8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:13Z,use_quota=True,user_id='238615cb41834258a59a273d76a9b27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7632f65-772e-4c2d-896e-2f2911411cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7632f65-772e-4c2d-896e-2f2911411cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5df26e7-de3b-45a1-8500-71d001671032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5df26e7-de3b-45a1-8500-71d001671032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40237051-cc2c-4447-adaf-e1dc5c924ccb', 'volume_name': 'volume-40237051-cc2c-4447-adaf-e1dc5c924ccb', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9063f35f-9fd5-4d0c-997a-626ef41f46a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9063f35f-9fd5-4d0c-997a-626ef41f46a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1abc685-5b9c-485a-bee0-f8e48b3d41b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:13 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] Volume 40237051-cc2c-4447-adaf-e1dc5c924ccb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40237051-cc2c-4447-adaf-e1dc5c924ccb', 'volume_size': 1} Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-743285628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40237051-cc2c-4447-adaf-e1dc5c924ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='656bf2f907254f56b3b3dc931d1da8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:13Z,use_quota=True,user_id='238615cb41834258a59a273d76a9b27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] Creating volume 40237051-cc2c-4447-adaf-e1dc5c924ccb {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:10:13 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:13 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:13 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb 1073741824 Sep 01 02:10:13 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7244e6e4-7e23-4d13-a9cb-39f7ada8b73f tempest-TestStampPattern-539610372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511.0bba738f-5a6b-40ef-b6ba-00a5c4b1700f" returned: 0 in 0.471s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7244e6e4-7e23-4d13-a9cb-39f7ada8b73f tempest-TestStampPattern-539610372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511.0bba738f-5a6b-40ef-b6ba-00a5c4b1700f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:13 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511.0bba738f-5a6b-40ef-b6ba-00a5c4b1700f Sep 01 02:10:13 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:13 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7244e6e4-7e23-4d13-a9cb-39f7ada8b73f tempest-TestStampPattern-539610372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511.0bba738f-5a6b-40ef-b6ba-00a5c4b1700f" returned: 0 in 0.322s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7244e6e4-7e23-4d13-a9cb-39f7ada8b73f tempest-TestStampPattern-539610372 None] Lock "cinder-quobyte-0bba738f-5a6b-40ef-b6ba-00a5c4b1700f" released by "_delete_snapshot" :: held 2.284s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7244e6e4-7e23-4d13-a9cb-39f7ada8b73f tempest-TestStampPattern-539610372 None] Lock "cinder-quobyte-eb7a50bd-eb42-44e5-85b6-86df7f66c511" released by "delete_snapshot" :: held 2.315s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-7244e6e4-7e23-4d13-a9cb-39f7ada8b73f tempest-TestStampPattern-539610372 None] Created reservations ['fdb58dd5-6d7a-44a0-9f28-dc7050fb5efa', '3a02d94d-cd49-4b25-b1cb-d77151e989df', 'a11ff0cc-8bfb-4768-b5bc-25160e06c1ce', '9c5bfcb5-bdc2-455b-a23a-740a69bcbbdf'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:13 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-7244e6e4-7e23-4d13-a9cb-39f7ada8b73f tempest-TestStampPattern-539610372 None] Delete snapshot completed successfully. Sep 01 02:10:13 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb 1073741824" returned: 0 in 0.554s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7244e6e4-7e23-4d13-a9cb-39f7ada8b73f tempest-TestStampPattern-539610372 None] Lock "cinder-0bba738f-5a6b-40ef-b6ba-00a5c4b1700f-delete_snapshot" released by "delete_snapshot" :: held 2.498s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:13 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb Sep 01 02:10:13 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:14 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb" returned: 0 in 0.257s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:10:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1abc685-5b9c-485a-bee0-f8e48b3d41b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40237051-cc2c-4447-adaf-e1dc5c924ccb', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a237eb76-6dcf-4f97-996f-f51d03f348be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:14 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] Volume volume-40237051-cc2c-4447-adaf-e1dc5c924ccb (40237051-cc2c-4447-adaf-e1dc5c924ccb): created successfully Sep 01 02:10:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a237eb76-6dcf-4f97-996f-f51d03f348be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] Flow 'volume_create_manager' (ba6775bd-2918-48e0-96a7-9118d6e3ccc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:14 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-cee3aaa8-db07-4bda-ba30-22f93a8fa5f6 tempest-VolumesDeleteCascade-536606026 None] Created volume successfully. Sep 01 02:10:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-eed6e170-84d7-4ce9-a32c-5c50a11941ff tempest-VolumesDeleteCascade-536606026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-eed6e170-84d7-4ce9-a32c-5c50a11941ff tempest-VolumesDeleteCascade-536606026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:15 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:UPDATE=196,cinder:SELECT=150,cinder:INSERT=53,cinder:DELETE=20 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:10:15 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-eed6e170-84d7-4ce9-a32c-5c50a11941ff tempest-VolumesDeleteCascade-536606026 None] Creating offline snapshot df95d03b-32ab-47cb-aa58-967121c7d46e of volume 40237051-cc2c-4447-adaf-e1dc5c924ccb {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:10:15 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a658007-07ef-48a5-b218-c7c25c097239]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eed6e170-84d7-4ce9-a32c-5c50a11941ff tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:15 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb Sep 01 02:10:15 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:16 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eed6e170-84d7-4ce9-a32c-5c50a11941ff tempest-VolumesDeleteCascade-536606026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb" returned: 0 in 0.806s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eed6e170-84d7-4ce9-a32c-5c50a11941ff tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:16 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e 1G Sep 01 02:10:16 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:16 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:10:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:16 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eed6e170-84d7-4ce9-a32c-5c50a11941ff tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e 1G" returned: 0 in 0.544s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eed6e170-84d7-4ce9-a32c-5c50a11941ff tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40237051-cc2c-4447-adaf-e1dc5c924ccb -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:17 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:10:17 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:17 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40237051-cc2c-4447-adaf-e1dc5c924ccb -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e Sep 01 02:10:17 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:17 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.337s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:17 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:17 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager._thread_info {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:10:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread count: 29 {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:10:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread info: [<_MainThread(MainThread, started 128688016527488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:10:17 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eed6e170-84d7-4ce9-a32c-5c50a11941ff tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40237051-cc2c-4447-adaf-e1dc5c924ccb -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e" returned: 0 in 0.460s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:17 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-eed6e170-84d7-4ce9-a32c-5c50a11941ff tempest-VolumesDeleteCascade-536606026 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e is being set with open permissions: ugo+rw Sep 01 02:10:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eed6e170-84d7-4ce9-a32c-5c50a11941ff tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:17 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e Sep 01 02:10:17 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:17 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eed6e170-84d7-4ce9-a32c-5c50a11941ff tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e" returned: 0 in 0.438s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eed6e170-84d7-4ce9-a32c-5c50a11941ff tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:17 devstack sudo[101408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.info Sep 01 02:10:17 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:18 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eed6e170-84d7-4ce9-a32c-5c50a11941ff tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.info" returned: 0 in 0.321s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:18 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-eed6e170-84d7-4ce9-a32c-5c50a11941ff tempest-VolumesDeleteCascade-536606026 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.info is being set with open permissions: ugo+rw Sep 01 02:10:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eed6e170-84d7-4ce9-a32c-5c50a11941ff tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:18 devstack sudo[101411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.info Sep 01 02:10:18 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:18 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eed6e170-84d7-4ce9-a32c-5c50a11941ff tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.info" returned: 0 in 0.279s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-eed6e170-84d7-4ce9-a32c-5c50a11941ff tempest-VolumesDeleteCascade-536606026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.983s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:18 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-eed6e170-84d7-4ce9-a32c-5c50a11941ff tempest-VolumesDeleteCascade-536606026 None] Create snapshot completed successfully Sep 01 02:10:18 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e6cf087e-50b3-4abb-a2d4-ff7584bad00e tempest-TestStampPattern-539610372 None] Acquiring lock "cinder-eb7a50bd-eb42-44e5-85b6-86df7f66c511-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:18 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e6cf087e-50b3-4abb-a2d4-ff7584bad00e tempest-TestStampPattern-539610372 None] Lock "cinder-eb7a50bd-eb42-44e5-85b6-86df7f66c511-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:18 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e6cf087e-50b3-4abb-a2d4-ff7584bad00e tempest-TestStampPattern-539610372 None] Acquiring lock "cinder-quobyte-eb7a50bd-eb42-44e5-85b6-86df7f66c511" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:18 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e6cf087e-50b3-4abb-a2d4-ff7584bad00e tempest-TestStampPattern-539610372 None] Lock "cinder-quobyte-eb7a50bd-eb42-44e5-85b6-86df7f66c511" acquired by "delete_volume" :: waited 0.023s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:18 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea760bb1-28f2-4874-9d3e-c8fd4788f0a3]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e6cf087e-50b3-4abb-a2d4-ff7584bad00e tempest-TestStampPattern-539610372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8a77fdd0-54fe-46c0-b123-01c04938af8a tempest-VolumesDeleteCascade-536606026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8a77fdd0-54fe-46c0-b123-01c04938af8a tempest-VolumesDeleteCascade-536606026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:19 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-8a77fdd0-54fe-46c0-b123-01c04938af8a tempest-VolumesDeleteCascade-536606026 None] Creating offline snapshot 69c317f1-9c6f-43a3-b354-b44aef77e5d8 of volume 40237051-cc2c-4447-adaf-e1dc5c924ccb {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:10:19 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511 Sep 01 02:10:19 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:19 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57924d8-8999-4c5e-90aa-51400e1f9a22]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8a77fdd0-54fe-46c0-b123-01c04938af8a tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:19 devstack sudo[101416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e Sep 01 02:10:19 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:19 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e6cf087e-50b3-4abb-a2d4-ff7584bad00e tempest-TestStampPattern-539610372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511" returned: 0 in 0.475s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e6cf087e-50b3-4abb-a2d4-ff7584bad00e tempest-TestStampPattern-539610372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:19 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511 Sep 01 02:10:19 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:19 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8a77fdd0-54fe-46c0-b123-01c04938af8a tempest-VolumesDeleteCascade-536606026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e" returned: 0 in 0.422s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:19 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-8a77fdd0-54fe-46c0-b123-01c04938af8a tempest-VolumesDeleteCascade-536606026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40237051-cc2c-4447-adaf-e1dc5c924ccb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:10:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8a77fdd0-54fe-46c0-b123-01c04938af8a tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.69c317f1-9c6f-43a3-b354-b44aef77e5d8 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:19 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.69c317f1-9c6f-43a3-b354-b44aef77e5d8 1G Sep 01 02:10:19 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:19 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e6cf087e-50b3-4abb-a2d4-ff7584bad00e tempest-TestStampPattern-539610372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb7a50bd-eb42-44e5-85b6-86df7f66c511" returned: 0 in 0.361s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e6cf087e-50b3-4abb-a2d4-ff7584bad00e tempest-TestStampPattern-539610372 None] Lock "cinder-quobyte-eb7a50bd-eb42-44e5-85b6-86df7f66c511" released by "delete_volume" :: held 0.905s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:19 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-e6cf087e-50b3-4abb-a2d4-ff7584bad00e tempest-TestStampPattern-539610372 None] Created reservations ['1a39ca78-f679-41cd-8420-7f8f4b36970c', 'ba92ac97-2c15-4947-a59b-fce2cb6abe80', '1dabaaeb-1ede-443a-be38-a201dae83c6b', '19918d82-05cf-4484-8626-1ef5282e794a'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e6cf087e-50b3-4abb-a2d4-ff7584bad00e tempest-TestStampPattern-539610372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e6cf087e-50b3-4abb-a2d4-ff7584bad00e tempest-TestStampPattern-539610372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:19 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e6cf087e-50b3-4abb-a2d4-ff7584bad00e tempest-TestStampPattern-539610372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:19 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e6cf087e-50b3-4abb-a2d4-ff7584bad00e tempest-TestStampPattern-539610372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e6cf087e-50b3-4abb-a2d4-ff7584bad00e tempest-TestStampPattern-539610372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e6cf087e-50b3-4abb-a2d4-ff7584bad00e tempest-TestStampPattern-539610372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:19 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:10:19 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:20 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8a77fdd0-54fe-46c0-b123-01c04938af8a tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.69c317f1-9c6f-43a3-b354-b44aef77e5d8 1G" returned: 0 in 0.572s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8a77fdd0-54fe-46c0-b123-01c04938af8a tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.69c317f1-9c6f-43a3-b354-b44aef77e5d8 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:20 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.69c317f1-9c6f-43a3-b354-b44aef77e5d8 Sep 01 02:10:20 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:20 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e6cf087e-50b3-4abb-a2d4-ff7584bad00e tempest-TestStampPattern-539610372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.252s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:20 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-e6cf087e-50b3-4abb-a2d4-ff7584bad00e tempest-TestStampPattern-539610372 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:20 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-e6cf087e-50b3-4abb-a2d4-ff7584bad00e tempest-TestStampPattern-539610372 None] Deleted volume successfully. Sep 01 02:10:20 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e6cf087e-50b3-4abb-a2d4-ff7584bad00e tempest-TestStampPattern-539610372 None] Lock "cinder-eb7a50bd-eb42-44e5-85b6-86df7f66c511-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:20 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8a77fdd0-54fe-46c0-b123-01c04938af8a tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.69c317f1-9c6f-43a3-b354-b44aef77e5d8" returned: 0 in 0.332s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:20 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-8a77fdd0-54fe-46c0-b123-01c04938af8a tempest-VolumesDeleteCascade-536606026 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.69c317f1-9c6f-43a3-b354-b44aef77e5d8 is being set with open permissions: ugo+rw Sep 01 02:10:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8a77fdd0-54fe-46c0-b123-01c04938af8a tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.69c317f1-9c6f-43a3-b354-b44aef77e5d8 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:20 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.69c317f1-9c6f-43a3-b354-b44aef77e5d8 Sep 01 02:10:20 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:20 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8a77fdd0-54fe-46c0-b123-01c04938af8a tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.69c317f1-9c6f-43a3-b354-b44aef77e5d8" returned: 0 in 0.237s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8a77fdd0-54fe-46c0-b123-01c04938af8a tempest-VolumesDeleteCascade-536606026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.673s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:20 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-8a77fdd0-54fe-46c0-b123-01c04938af8a tempest-VolumesDeleteCascade-536606026 None] Create snapshot completed successfully Sep 01 02:10:21 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Acquiring lock "cinder-40237051-cc2c-4447-adaf-e1dc5c924ccb-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:21 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-40237051-cc2c-4447-adaf-e1dc5c924ccb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Performing cascade delete. {{(pid=87128) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 01 02:10:21 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Acquiring lock "cinder-69c317f1-9c6f-43a3-b354-b44aef77e5d8-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:21 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-69c317f1-9c6f-43a3-b354-b44aef77e5d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:21 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Acquiring lock "cinder-quobyte-40237051-cc2c-4447-adaf-e1dc5c924ccb" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:21 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-quobyte-40237051-cc2c-4447-adaf-e1dc5c924ccb" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:21 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Acquiring lock "cinder-quobyte-69c317f1-9c6f-43a3-b354-b44aef77e5d8" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:21 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-quobyte-69c317f1-9c6f-43a3-b354-b44aef77e5d8" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Deleting offline snapshot 69c317f1-9c6f-43a3-b354-b44aef77e5d8 of volume 40237051-cc2c-4447-adaf-e1dc5c924ccb {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:10:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] snapshot_file for this snap is: volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.69c317f1-9c6f-43a3-b354-b44aef77e5d8 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:10:21 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c334a3-5ad2-4ca4-8401-b61b7da8378a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.69c317f1-9c6f-43a3-b354-b44aef77e5d8 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:21 devstack sudo[101476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.69c317f1-9c6f-43a3-b354-b44aef77e5d8 Sep 01 02:10:21 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:22 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.69c317f1-9c6f-43a3-b354-b44aef77e5d8" returned: 0 in 0.446s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:22 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40237051-cc2c-4447-adaf-e1dc5c924ccb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:10:22 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb10953-6707-4fca-b0f4-ab3fb9e08bdc]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:22 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e Sep 01 02:10:22 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:22 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e" returned: 0 in 0.415s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:22 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40237051-cc2c-4447-adaf-e1dc5c924ccb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:10:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.69c317f1-9c6f-43a3-b354-b44aef77e5d8 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:22 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.69c317f1-9c6f-43a3-b354-b44aef77e5d8 Sep 01 02:10:22 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:22 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.69c317f1-9c6f-43a3-b354-b44aef77e5d8" returned: 0 in 0.426s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.69c317f1-9c6f-43a3-b354-b44aef77e5d8 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:22 devstack sudo[101494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.69c317f1-9c6f-43a3-b354-b44aef77e5d8 Sep 01 02:10:22 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:23 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.69c317f1-9c6f-43a3-b354-b44aef77e5d8" returned: 0 in 0.303s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-quobyte-69c317f1-9c6f-43a3-b354-b44aef77e5d8" released by "_delete_snapshot" :: held 1.706s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-quobyte-40237051-cc2c-4447-adaf-e1dc5c924ccb" released by "delete_snapshot" :: held 1.749s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:23 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Created reservations ['fb4acb08-0d8e-4b76-934c-c8f5ff43fe44', 'b35d6376-dd80-4244-aa3a-474fa492709c', '9821a144-ba13-42b2-b34c-dc0560356d99', '6734a701-c37c-43cf-b03d-cdbc5db5d611'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:23 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Delete snapshot completed successfully. Sep 01 02:10:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-69c317f1-9c6f-43a3-b354-b44aef77e5d8-delete_snapshot" released by "delete_snapshot" :: held 1.984s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Acquiring lock "cinder-df95d03b-32ab-47cb-aa58-967121c7d46e-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-df95d03b-32ab-47cb-aa58-967121c7d46e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Acquiring lock "cinder-quobyte-40237051-cc2c-4447-adaf-e1dc5c924ccb" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-quobyte-40237051-cc2c-4447-adaf-e1dc5c924ccb" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Acquiring lock "cinder-quobyte-df95d03b-32ab-47cb-aa58-967121c7d46e" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-quobyte-df95d03b-32ab-47cb-aa58-967121c7d46e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:23 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Deleting offline snapshot df95d03b-32ab-47cb-aa58-967121c7d46e of volume 40237051-cc2c-4447-adaf-e1dc5c924ccb {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:10:23 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] snapshot_file for this snap is: volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:10:23 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[43692dc4-2184-4fab-8df6-eb09a8452f5f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:23 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e Sep 01 02:10:23 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:24 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e" returned: 0 in 0.422s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:24 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40237051-cc2c-4447-adaf-e1dc5c924ccb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:10:24 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e86060-fa70-48e7-b0b2-3f906c38072a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:24 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb Sep 01 02:10:24 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:24 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb" returned: 0 in 0.479s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:24 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e Sep 01 02:10:24 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:24 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e" returned: 0 in 0.409s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:24 devstack sudo[101547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e Sep 01 02:10:24 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:25 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb.df95d03b-32ab-47cb-aa58-967121c7d46e" returned: 0 in 0.320s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-quobyte-df95d03b-32ab-47cb-aa58-967121c7d46e" released by "_delete_snapshot" :: held 1.747s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-quobyte-40237051-cc2c-4447-adaf-e1dc5c924ccb" released by "delete_snapshot" :: held 1.770s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:25 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Created reservations ['b610cfb4-40eb-419b-b463-2a85680e2676', '67d51ef4-b2ba-45e2-be30-c4c42704459f', '225c65a8-266b-4ffb-9e55-ad930926a3e7', '70730dbc-5e88-4015-90ab-bd48d50a9d11'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:25 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Delete snapshot completed successfully. Sep 01 02:10:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-df95d03b-32ab-47cb-aa58-967121c7d46e-delete_snapshot" released by "delete_snapshot" :: held 1.922s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Snapshots deleted, issuing volume delete {{(pid=87128) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 01 02:10:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Acquiring lock "cinder-quobyte-40237051-cc2c-4447-adaf-e1dc5c924ccb" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-quobyte-40237051-cc2c-4447-adaf-e1dc5c924ccb" acquired by "delete_volume" :: waited 0.013s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:25 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdcf5dc-22bd-4066-a09c-20f9bdc2b3a3]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:25 devstack sudo[101554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb Sep 01 02:10:25 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:25 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb" returned: 0 in 0.392s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:25 devstack sudo[101559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb Sep 01 02:10:25 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:26 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-40237051-cc2c-4447-adaf-e1dc5c924ccb" returned: 0 in 0.337s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:26 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-quobyte-40237051-cc2c-4447-adaf-e1dc5c924ccb" released by "delete_volume" :: held 0.790s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:26 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Created reservations ['894edb86-2d0f-4051-826a-b88c9c647ff9', '50213610-757b-4e9a-8b3d-38b2037e7cfb', '04856ffb-a606-4b20-acff-b78974e774bd', '251996cd-874b-414b-a967-960b7f4451e4'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:26 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:26 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:26 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:10:26 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:26 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.261s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:26 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:26 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Deleted volume successfully. Sep 01 02:10:26 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-64ab4b22-bcbd-4aeb-82ed-1f2ba29e6390 tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-40237051-cc2c-4447-adaf-e1dc5c924ccb-delete_volume" released by "delete_volume" :: held 5.307s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:27 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] Flow 'volume_create_manager' (f111ca91-7840-4e9f-97c5-47a01616f004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e71d8040-8c7c-4011-9496-0ce98b610d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e71d8040-8c7c-4011-9496-0ce98b610d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2099892479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce9d1ab4-1e35-4d5a-817a-9db436d85504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='656bf2f907254f56b3b3dc931d1da8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:28Z,use_quota=True,user_id='238615cb41834258a59a273d76a9b27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f314d7d-7713-412f-8e14-6352f3535e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f314d7d-7713-412f-8e14-6352f3535e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a6e47c-f867-40e3-b2da-f39cd425c569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a6e47c-f867-40e3-b2da-f39cd425c569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce9d1ab4-1e35-4d5a-817a-9db436d85504', 'volume_name': 'volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85274c7e-cd81-4f72-afa0-7890848c452e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85274c7e-cd81-4f72-afa0-7890848c452e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c8ed412-6358-41d9-bbe2-8291838d7eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:27 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] Volume ce9d1ab4-1e35-4d5a-817a-9db436d85504: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504', 'volume_size': 1} Sep 01 02:10:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2099892479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce9d1ab4-1e35-4d5a-817a-9db436d85504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='656bf2f907254f56b3b3dc931d1da8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:28Z,use_quota=True,user_id='238615cb41834258a59a273d76a9b27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:10:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] Creating volume ce9d1ab4-1e35-4d5a-817a-9db436d85504 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:10:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:10:27 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:10:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:27 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504 1073741824 Sep 01 02:10:27 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:28 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504 1073741824" returned: 0 in 0.492s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:28 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504 Sep 01 02:10:28 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:28 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504" returned: 0 in 0.291s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:28 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:10:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c8ed412-6358-41d9-bbe2-8291838d7eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f8eb10f-7c85-43de-8a3e-208f8461a213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:28 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] Volume volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504 (ce9d1ab4-1e35-4d5a-817a-9db436d85504): created successfully Sep 01 02:10:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f8eb10f-7c85-43de-8a3e-208f8461a213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] Flow 'volume_create_manager' (f111ca91-7840-4e9f-97c5-47a01616f004) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:28 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-28a0ce20-0064-456a-9e31-712297cf5f9e tempest-VolumesDeleteCascade-536606026 None] Created volume successfully. Sep 01 02:10:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c036d62b-1778-41d3-9f0a-30a2d3a4ec5f tempest-VolumesDeleteCascade-536606026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c036d62b-1778-41d3-9f0a-30a2d3a4ec5f tempest-VolumesDeleteCascade-536606026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:29 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-c036d62b-1778-41d3-9f0a-30a2d3a4ec5f tempest-VolumesDeleteCascade-536606026 None] Creating offline snapshot 0112990c-4eb3-4f7b-8d49-fb99da7c80fb of volume ce9d1ab4-1e35-4d5a-817a-9db436d85504 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:10:29 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81242a2-e405-4d0b-afc6-977e69747e9f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c036d62b-1778-41d3-9f0a-30a2d3a4ec5f tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:30 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504 Sep 01 02:10:30 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:30 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c036d62b-1778-41d3-9f0a-30a2d3a4ec5f tempest-VolumesDeleteCascade-536606026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504" returned: 0 in 0.422s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c036d62b-1778-41d3-9f0a-30a2d3a4ec5f tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504.0112990c-4eb3-4f7b-8d49-fb99da7c80fb 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:30 devstack sudo[101587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504.0112990c-4eb3-4f7b-8d49-fb99da7c80fb 1G Sep 01 02:10:30 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:30 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c036d62b-1778-41d3-9f0a-30a2d3a4ec5f tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504.0112990c-4eb3-4f7b-8d49-fb99da7c80fb 1G" returned: 0 in 0.414s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c036d62b-1778-41d3-9f0a-30a2d3a4ec5f tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504.0112990c-4eb3-4f7b-8d49-fb99da7c80fb {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:30 devstack sudo[101592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504.0112990c-4eb3-4f7b-8d49-fb99da7c80fb Sep 01 02:10:30 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:31 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c036d62b-1778-41d3-9f0a-30a2d3a4ec5f tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504.0112990c-4eb3-4f7b-8d49-fb99da7c80fb" returned: 0 in 0.367s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:31 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-c036d62b-1778-41d3-9f0a-30a2d3a4ec5f tempest-VolumesDeleteCascade-536606026 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504.0112990c-4eb3-4f7b-8d49-fb99da7c80fb is being set with open permissions: ugo+rw Sep 01 02:10:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c036d62b-1778-41d3-9f0a-30a2d3a4ec5f tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504.0112990c-4eb3-4f7b-8d49-fb99da7c80fb {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:31 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504.0112990c-4eb3-4f7b-8d49-fb99da7c80fb Sep 01 02:10:31 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:31 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c036d62b-1778-41d3-9f0a-30a2d3a4ec5f tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504.0112990c-4eb3-4f7b-8d49-fb99da7c80fb" returned: 0 in 0.358s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c036d62b-1778-41d3-9f0a-30a2d3a4ec5f tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:31 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504.info Sep 01 02:10:31 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:31 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c036d62b-1778-41d3-9f0a-30a2d3a4ec5f tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504.info" returned: 0 in 0.296s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:31 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-c036d62b-1778-41d3-9f0a-30a2d3a4ec5f tempest-VolumesDeleteCascade-536606026 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504.info is being set with open permissions: ugo+rw Sep 01 02:10:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c036d62b-1778-41d3-9f0a-30a2d3a4ec5f tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:31 devstack sudo[101605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504.info Sep 01 02:10:31 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:32 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c036d62b-1778-41d3-9f0a-30a2d3a4ec5f tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504.info" returned: 0 in 0.289s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c036d62b-1778-41d3-9f0a-30a2d3a4ec5f tempest-VolumesDeleteCascade-536606026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.254s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:32 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-c036d62b-1778-41d3-9f0a-30a2d3a4ec5f tempest-VolumesDeleteCascade-536606026 None] Create snapshot completed successfully Sep 01 02:10:33 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Flow 'volume_create_manager' (f6604a24-90aa-4515-b87d-eee4a98330c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a57df8-72e5-424d-9816-637676cb3429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a57df8-72e5-424d-9816-637676cb3429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-795584287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac272c69-044a-4d37-bf55-db1fd89f9d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='febc890659a841e59910d6b234956778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:34Z,use_quota=True,user_id='702cb5fc01984ea7ae4e828ae9503235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (191d17e4-3246-4403-ae17-659904dee302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (191d17e4-3246-4403-ae17-659904dee302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (563fe801-8cc4-4f81-a65e-8f2e4dd65224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (563fe801-8cc4-4f81-a65e-8f2e4dd65224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac272c69-044a-4d37-bf55-db1fd89f9d27', 'volume_name': 'volume-ac272c69-044a-4d37-bf55-db1fd89f9d27', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adca9833-b3f3-4730-8da8-ba0b01f80168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adca9833-b3f3-4730-8da8-ba0b01f80168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8265c143-bcbf-49d4-a3eb-ed377abdb664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:33 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Volume ac272c69-044a-4d37-bf55-db1fd89f9d27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac272c69-044a-4d37-bf55-db1fd89f9d27', 'volume_size': 1} Sep 01 02:10:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-795584287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac272c69-044a-4d37-bf55-db1fd89f9d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='febc890659a841e59910d6b234956778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:34Z,use_quota=True,user_id='702cb5fc01984ea7ae4e828ae9503235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:10:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Creating volume ac272c69-044a-4d37-bf55-db1fd89f9d27 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:10:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:10:33 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:10:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ac272c69-044a-4d37-bf55-db1fd89f9d27 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:33 devstack sudo[101612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ac272c69-044a-4d37-bf55-db1fd89f9d27 1073741824 Sep 01 02:10:33 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Flow 'volume_create_manager' (6b6f4301-98c6-43a1-bce1-cfdce2c0fd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de7da5d-9107-4137-bf6a-a8edc36af066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de7da5d-9107-4137-bf6a-a8edc36af066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1922721917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b062f29e-552d-43b1-8b85-75b569d41c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='656bf2f907254f56b3b3dc931d1da8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0112990c-4eb3-4f7b-8d49-fb99da7c80fb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:34Z,use_quota=True,user_id='238615cb41834258a59a273d76a9b27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8158805d-aaf8-46ca-b1e0-dcbcde7818c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8158805d-aaf8-46ca-b1e0-dcbcde7818c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e38aa00-d336-4173-95dc-18102082f745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e38aa00-d336-4173-95dc-18102082f745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b062f29e-552d-43b1-8b85-75b569d41c07', 'volume_name': 'volume-b062f29e-552d-43b1-8b85-75b569d41c07', 'volume_size': 1, 'snapshot_id': '0112990c-4eb3-4f7b-8d49-fb99da7c80fb'}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5411cc6-a057-4159-bd07-36be40096fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5411cc6-a057-4159-bd07-36be40096fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fdc2a2b-3fd5-4c17-8e32-4a8950773e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:34 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Volume b062f29e-552d-43b1-8b85-75b569d41c07: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b062f29e-552d-43b1-8b85-75b569d41c07', 'volume_size': 1, 'snapshot_id': '0112990c-4eb3-4f7b-8d49-fb99da7c80fb'} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:34 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ac272c69-044a-4d37-bf55-db1fd89f9d27 1073741824" returned: 0 in 0.516s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ac272c69-044a-4d37-bf55-db1fd89f9d27 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:34 devstack sudo[101618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ac272c69-044a-4d37-bf55-db1fd89f9d27 Sep 01 02:10:34 devstack sudo[101618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:34 devstack sudo[101618]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ac272c69-044a-4d37-bf55-db1fd89f9d27" returned: 0 in 0.322s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.667s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Acquiring lock "cinder-quobyte-0112990c-4eb3-4f7b-8d49-fb99da7c80fb-b062f29e-552d-43b1-8b85-75b569d41c07" by "_create_volume_from_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8265c143-bcbf-49d4-a3eb-ed377abdb664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac272c69-044a-4d37-bf55-db1fd89f9d27', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea52cc5b-d1b6-4616-b878-835a06027aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-quobyte-0112990c-4eb3-4f7b-8d49-fb99da7c80fb-b062f29e-552d-43b1-8b85-75b569d41c07" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Creating volume b062f29e-552d-43b1-8b85-75b569d41c07 from snapshot 0112990c-4eb3-4f7b-8d49-fb99da7c80fb {{(pid=87128) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Acquiring lock "cinder-quobyte-b062f29e-552d-43b1-8b85-75b569d41c07" by "_copy_volume_from_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:34 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Volume volume-ac272c69-044a-4d37-bf55-db1fd89f9d27 (ac272c69-044a-4d37-bf55-db1fd89f9d27): created successfully Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea52cc5b-d1b6-4616-b878-835a06027aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Flow 'volume_create_manager' (f6604a24-90aa-4515-b87d-eee4a98330c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-quobyte-b062f29e-552d-43b1-8b85-75b569d41c07" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] snapshot: 0112990c-4eb3-4f7b-8d49-fb99da7c80fb, volume: b062f29e-552d-43b1-8b85-75b569d41c07, {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:10:34 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-23460ed7-e9c0-4f61-9902-0b18718cbe9b tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Created volume successfully. Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c33b6b-d295-4a33-a165-ffa6f2f8607a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504.0112990c-4eb3-4f7b-8d49-fb99da7c80fb {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:35 devstack sudo[101621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504.0112990c-4eb3-4f7b-8d49-fb99da7c80fb Sep 01 02:10:35 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:35 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504.0112990c-4eb3-4f7b-8d49-fb99da7c80fb" returned: 0 in 0.390s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:35 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:10:35 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a2fe83-d7c5-48de-b01b-cc9d476ce295]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:35 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504 Sep 01 02:10:35 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:35 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504" returned: 0 in 0.398s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:35 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504 {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:10:35 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Creating direct copy from snapshot {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:10:35 devstack cinder-volume[87128]: DEBUG cinder.utils [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Path /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b062f29e-552d-43b1-8b85-75b569d41c07 not found in is_blk_device check {{(pid=87128) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:10:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b062f29e-552d-43b1-8b85-75b569d41c07 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:35 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b062f29e-552d-43b1-8b85-75b569d41c07 Sep 01 02:10:35 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:36 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] Flow 'volume_create_manager' (22d1b603-a574-4ebd-b999-e236ff2b4af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfdc44b0-d081-4200-8c19-d4c00994cbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfdc44b0-d081-4200-8c19-d4c00994cbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1650814613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6442afd6-d83a-43bd-8ca3-ec7eec9b79a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11fc2c2b97c42e58255873bee0ddaaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:36Z,use_quota=True,user_id='0f771f2af5d14b029aa971b1d2ec44e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c38d52-3f94-41e9-8760-19ccf85e3b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c38d52-3f94-41e9-8760-19ccf85e3b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e512859d-094a-480e-abbe-05d603f05783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e512859d-094a-480e-abbe-05d603f05783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6442afd6-d83a-43bd-8ca3-ec7eec9b79a5', 'volume_name': 'volume-6442afd6-d83a-43bd-8ca3-ec7eec9b79a5', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c47a57c0-5330-4788-965d-2f4ad9882f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c47a57c0-5330-4788-965d-2f4ad9882f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74512712-ec43-439b-bbd9-f6735175909a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:36 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] Volume 6442afd6-d83a-43bd-8ca3-ec7eec9b79a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6442afd6-d83a-43bd-8ca3-ec7eec9b79a5', 'volume_size': 1} Sep 01 02:10:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-ba16c67b-e925-44a5-af8e-05a71b19aa50 req-99b46311-3fbd-463f-9a15-c70802ba845a tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:37 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] Flow 'volume_create_manager' (36677291-8f64-436d-974d-376c23d65601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f0495d-9aaf-4549-a9ec-bea8fcd2126b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f0495d-9aaf-4549-a9ec-bea8fcd2126b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-324370318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19055d6c-2ec7-4405-ad43-320572c153c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11fc2c2b97c42e58255873bee0ddaaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:37Z,use_quota=True,user_id='0f771f2af5d14b029aa971b1d2ec44e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d07b42b0-3366-4fae-9bf8-db3703aa5a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d07b42b0-3366-4fae-9bf8-db3703aa5a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42394c74-fdad-4e4b-9bc6-bed265108c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42394c74-fdad-4e4b-9bc6-bed265108c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19055d6c-2ec7-4405-ad43-320572c153c8', 'volume_name': 'volume-19055d6c-2ec7-4405-ad43-320572c153c8', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7cb8a60-b9e0-4857-aac5-b875f4edc7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7cb8a60-b9e0-4857-aac5-b875f4edc7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72e83e1-9370-42b0-b647-5eabd4cf0d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:37 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] Volume 19055d6c-2ec7-4405-ad43-320572c153c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19055d6c-2ec7-4405-ad43-320572c153c8', 'volume_size': 1} Sep 01 02:10:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:37 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] Flow 'volume_create_manager' (57702692-a91f-48f6-b72e-a39f5a0e2d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b342d8ac-2001-419e-963e-92a3c809314b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b342d8ac-2001-419e-963e-92a3c809314b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1436288077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a355e30e-e6b4-4460-bfd5-8a69115ec9c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11fc2c2b97c42e58255873bee0ddaaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:38Z,use_quota=True,user_id='0f771f2af5d14b029aa971b1d2ec44e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6acd0bd-d548-4ee2-be03-488cd53e5339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6acd0bd-d548-4ee2-be03-488cd53e5339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9cda141-b44e-4964-8fbd-d8987b7475d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9cda141-b44e-4964-8fbd-d8987b7475d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a355e30e-e6b4-4460-bfd5-8a69115ec9c3', 'volume_name': 'volume-a355e30e-e6b4-4460-bfd5-8a69115ec9c3', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cccf3fa0-23ae-4eec-8040-cfa6483277e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cccf3fa0-23ae-4eec-8040-cfa6483277e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93fa364e-82d1-46ab-a072-f71bcd93b0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:38 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] Volume a355e30e-e6b4-4460-bfd5-8a69115ec9c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a355e30e-e6b4-4460-bfd5-8a69115ec9c3', 'volume_size': 1} Sep 01 02:10:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:38 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] Flow 'volume_create_manager' (245ec047-9a9e-460c-b3d2-33512f2d92f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e7c13ce-dc7c-4dd0-a44a-3557136061a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e7c13ce-dc7c-4dd0-a44a-3557136061a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2074885623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0edae06b-b31b-4e26-8c13-fa05c9ee162f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11fc2c2b97c42e58255873bee0ddaaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:39Z,use_quota=True,user_id='0f771f2af5d14b029aa971b1d2ec44e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01506b91-9940-4f99-a850-66610e570276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01506b91-9940-4f99-a850-66610e570276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cbe3994-9740-4b37-ace3-5bad5bd92576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cbe3994-9740-4b37-ace3-5bad5bd92576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0edae06b-b31b-4e26-8c13-fa05c9ee162f', 'volume_name': 'volume-0edae06b-b31b-4e26-8c13-fa05c9ee162f', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d722dd4e-5cfb-4a69-a9d8-fc98b9eccd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d722dd4e-5cfb-4a69-a9d8-fc98b9eccd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd25c196-3251-4ff6-9cab-86f0af131e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:38 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] Volume 0edae06b-b31b-4e26-8c13-fa05c9ee162f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0edae06b-b31b-4e26-8c13-fa05c9ee162f', 'volume_size': 1} Sep 01 02:10:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:39 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] Flow 'volume_create_manager' (7fe6bd6e-f818-448d-b515-41554038db08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd07de0-f0d3-4e64-9ec6-ac6f3898c667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd07de0-f0d3-4e64-9ec6-ac6f3898c667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-90891551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e623a76-80c5-4eef-b463-5d5e7128ff12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11fc2c2b97c42e58255873bee0ddaaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:40Z,use_quota=True,user_id='0f771f2af5d14b029aa971b1d2ec44e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff310487-ec25-40cd-92c6-dc350e0c0a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff310487-ec25-40cd-92c6-dc350e0c0a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16dfe083-e97c-41bb-9011-9f2fe6b7f109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16dfe083-e97c-41bb-9011-9f2fe6b7f109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e623a76-80c5-4eef-b463-5d5e7128ff12', 'volume_name': 'volume-1e623a76-80c5-4eef-b463-5d5e7128ff12', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd775da7-69de-436e-a14c-5faac9604812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd775da7-69de-436e-a14c-5faac9604812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0afc3ff1-a07a-4b4e-a062-04058634a1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:39 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] Volume 1e623a76-80c5-4eef-b463-5d5e7128ff12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e623a76-80c5-4eef-b463-5d5e7128ff12', 'volume_size': 1} Sep 01 02:10:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:40 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b062f29e-552d-43b1-8b85-75b569d41c07" returned: 0 in 5.172s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:40 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504, size 1024.00 MB, duration 5.17 sec, destination /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b062f29e-552d-43b1-8b85-75b569d41c07 {{(pid=87128) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:10:40 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Converted 1024.00 MB image at 197.95 MB/s Sep 01 02:10:40 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b062f29e-552d-43b1-8b85-75b569d41c07 is being set with open permissions: ugo+rw Sep 01 02:10:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b062f29e-552d-43b1-8b85-75b569d41c07 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:40 devstack sudo[101663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b062f29e-552d-43b1-8b85-75b569d41c07 Sep 01 02:10:40 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:41 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b062f29e-552d-43b1-8b85-75b569d41c07" returned: 0 in 0.240s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-quobyte-b062f29e-552d-43b1-8b85-75b569d41c07" released by "_copy_volume_from_snapshot" :: held 6.295s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-quobyte-0112990c-4eb3-4f7b-8d49-fb99da7c80fb-b062f29e-552d-43b1-8b85-75b569d41c07" released by "_create_volume_from_snapshot" :: held 6.379s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.414s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.808s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1650814613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6442afd6-d83a-43bd-8ca3-ec7eec9b79a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11fc2c2b97c42e58255873bee0ddaaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:36Z,use_quota=True,user_id='0f771f2af5d14b029aa971b1d2ec44e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] Creating volume 6442afd6-d83a-43bd-8ca3-ec7eec9b79a5 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:10:41 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6442afd6-d83a-43bd-8ca3-ec7eec9b79a5 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:41 devstack sudo[101666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6442afd6-d83a-43bd-8ca3-ec7eec9b79a5 1073741824 Sep 01 02:10:41 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fdc2a2b-3fd5-4c17-8e32-4a8950773e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b062f29e-552d-43b1-8b85-75b569d41c07', 'volume_size': 1, 'snapshot_id': '0112990c-4eb3-4f7b-8d49-fb99da7c80fb'}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49516579-6aaf-453a-9a4b-54e76af7acde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:41 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Volume volume-b062f29e-552d-43b1-8b85-75b569d41c07 (b062f29e-552d-43b1-8b85-75b569d41c07): created successfully Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49516579-6aaf-453a-9a4b-54e76af7acde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Flow 'volume_create_manager' (6b6f4301-98c6-43a1-bce1-cfdce2c0fd70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:41 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-a56e7932-8e7a-48e3-bdae-4b69f14c872f tempest-VolumesDeleteCascade-536606026 None] Created volume successfully. Sep 01 02:10:41 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6442afd6-d83a-43bd-8ca3-ec7eec9b79a5 1073741824" returned: 0 in 0.390s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6442afd6-d83a-43bd-8ca3-ec7eec9b79a5 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:41 devstack sudo[101672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6442afd6-d83a-43bd-8ca3-ec7eec9b79a5 Sep 01 02:10:41 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:41 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6442afd6-d83a-43bd-8ca3-ec7eec9b79a5" returned: 0 in 0.238s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.668s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-ba16c67b-e925-44a5-af8e-05a71b19aa50 req-99b46311-3fbd-463f-9a15-c70802ba845a tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.717s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74512712-ec43-439b-bbd9-f6735175909a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6442afd6-d83a-43bd-8ca3-ec7eec9b79a5', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57e503b9-3ccc-4b1e-bc6e-b8d32d456f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-ba16c67b-e925-44a5-af8e-05a71b19aa50 req-99b46311-3fbd-463f-9a15-c70802ba845a tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.283s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-324370318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19055d6c-2ec7-4405-ad43-320572c153c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11fc2c2b97c42e58255873bee0ddaaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:37Z,use_quota=True,user_id='0f771f2af5d14b029aa971b1d2ec44e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] Creating volume 19055d6c-2ec7-4405-ad43-320572c153c8 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:10:41 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19055d6c-2ec7-4405-ad43-320572c153c8 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:41 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] Volume volume-6442afd6-d83a-43bd-8ca3-ec7eec9b79a5 (6442afd6-d83a-43bd-8ca3-ec7eec9b79a5): created successfully Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57e503b9-3ccc-4b1e-bc6e-b8d32d456f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:41 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19055d6c-2ec7-4405-ad43-320572c153c8 1073741824 Sep 01 02:10:41 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] Flow 'volume_create_manager' (22d1b603-a574-4ebd-b999-e236ff2b4af7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:41 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-bc8ea14d-4a5f-49b4-a36b-4d078fb5b935 tempest-CreateVolumesFromImageTest-947157763 None] Created volume successfully. Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-ba16c67b-e925-44a5-af8e-05a71b19aa50 req-99b46311-3fbd-463f-9a15-c70802ba845a tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb', 'name': 'volume-ac272c69-044a-4d37-bf55-db1fd89f9d27', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '56a45b2c-6835-4761-a02f-7215147450a2', 'enforce_multipath': True} {{(pid=87128) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:10:42 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-ba16c67b-e925-44a5-af8e-05a71b19aa50 req-99b46311-3fbd-463f-9a15-c70802ba845a tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] attachment_update completed successfully. Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Acquiring lock "cinder-ce9d1ab4-1e35-4d5a-817a-9db436d85504-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-ce9d1ab4-1e35-4d5a-817a-9db436d85504-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Performing cascade delete. {{(pid=87128) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Acquiring lock "cinder-0112990c-4eb3-4f7b-8d49-fb99da7c80fb-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-0112990c-4eb3-4f7b-8d49-fb99da7c80fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Acquiring lock "cinder-quobyte-ce9d1ab4-1e35-4d5a-817a-9db436d85504" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-quobyte-ce9d1ab4-1e35-4d5a-817a-9db436d85504" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Acquiring lock "cinder-quobyte-0112990c-4eb3-4f7b-8d49-fb99da7c80fb" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-quobyte-0112990c-4eb3-4f7b-8d49-fb99da7c80fb" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Deleting offline snapshot 0112990c-4eb3-4f7b-8d49-fb99da7c80fb of volume ce9d1ab4-1e35-4d5a-817a-9db436d85504 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] snapshot_file for this snap is: volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504.0112990c-4eb3-4f7b-8d49-fb99da7c80fb {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e561da-a406-4af8-9551-bb969c8aadcc]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504.0112990c-4eb3-4f7b-8d49-fb99da7c80fb {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:42 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19055d6c-2ec7-4405-ad43-320572c153c8 1073741824" returned: 0 in 0.518s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:42 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504.0112990c-4eb3-4f7b-8d49-fb99da7c80fb Sep 01 02:10:42 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19055d6c-2ec7-4405-ad43-320572c153c8 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:42 devstack sudo[102066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19055d6c-2ec7-4405-ad43-320572c153c8 Sep 01 02:10:42 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:42 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504.0112990c-4eb3-4f7b-8d49-fb99da7c80fb" returned: 0 in 0.477s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:10:42 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19055d6c-2ec7-4405-ad43-320572c153c8" returned: 0 in 0.340s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.760s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1436288077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a355e30e-e6b4-4460-bfd5-8a69115ec9c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11fc2c2b97c42e58255873bee0ddaaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:38Z,use_quota=True,user_id='0f771f2af5d14b029aa971b1d2ec44e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] Creating volume a355e30e-e6b4-4460-bfd5-8a69115ec9c3 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:10:42 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a355e30e-e6b4-4460-bfd5-8a69115ec9c3 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b85ad9-8cce-4df3-8402-28c8f5a00e1e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:42 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a355e30e-e6b4-4460-bfd5-8a69115ec9c3 1073741824 Sep 01 02:10:42 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72e83e1-9370-42b0-b647-5eabd4cf0d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19055d6c-2ec7-4405-ad43-320572c153c8', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc4364e-c90c-41c3-9a5e-56ff69f43de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:42 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] Volume volume-19055d6c-2ec7-4405-ad43-320572c153c8 (19055d6c-2ec7-4405-ad43-320572c153c8): created successfully Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc4364e-c90c-41c3-9a5e-56ff69f43de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] Flow 'volume_create_manager' (36677291-8f64-436d-974d-376c23d65601) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:42 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-e052b3dc-c151-4e85-9401-cbd57116d0b4 tempest-CreateVolumesFromImageTest-947157763 None] Created volume successfully. Sep 01 02:10:43 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504 Sep 01 02:10:43 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:43 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a355e30e-e6b4-4460-bfd5-8a69115ec9c3 1073741824" returned: 0 in 0.448s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a355e30e-e6b4-4460-bfd5-8a69115ec9c3 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:43 devstack sudo[102082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a355e30e-e6b4-4460-bfd5-8a69115ec9c3 Sep 01 02:10:43 devstack sudo[102082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:43 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504" returned: 0 in 0.549s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504.0112990c-4eb3-4f7b-8d49-fb99da7c80fb {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:43 devstack sudo[102085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504.0112990c-4eb3-4f7b-8d49-fb99da7c80fb Sep 01 02:10:43 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:43 devstack sudo[102082]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a355e30e-e6b4-4460-bfd5-8a69115ec9c3" returned: 0 in 0.250s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:43 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:10:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.700s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:43 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2074885623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0edae06b-b31b-4e26-8c13-fa05c9ee162f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11fc2c2b97c42e58255873bee0ddaaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:39Z,use_quota=True,user_id='0f771f2af5d14b029aa971b1d2ec44e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:10:43 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] Creating volume 0edae06b-b31b-4e26-8c13-fa05c9ee162f {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:10:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:43 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:43 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:43 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:10:43 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:10:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0edae06b-b31b-4e26-8c13-fa05c9ee162f 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:43 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0edae06b-b31b-4e26-8c13-fa05c9ee162f 1073741824 Sep 01 02:10:43 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93fa364e-82d1-46ab-a072-f71bcd93b0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a355e30e-e6b4-4460-bfd5-8a69115ec9c3', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cf46be1-9732-443a-b902-113c58856883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:43 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] Volume volume-a355e30e-e6b4-4460-bfd5-8a69115ec9c3 (a355e30e-e6b4-4460-bfd5-8a69115ec9c3): created successfully Sep 01 02:10:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cf46be1-9732-443a-b902-113c58856883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] Flow 'volume_create_manager' (57702692-a91f-48f6-b72e-a39f5a0e2d1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:43 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-72189411-92dd-4517-999f-3c1f9fe2f3b9 tempest-CreateVolumesFromImageTest-947157763 None] Created volume successfully. Sep 01 02:10:43 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504.0112990c-4eb3-4f7b-8d49-fb99da7c80fb" returned: 0 in 0.385s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504.0112990c-4eb3-4f7b-8d49-fb99da7c80fb {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:43 devstack sudo[102093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504.0112990c-4eb3-4f7b-8d49-fb99da7c80fb Sep 01 02:10:43 devstack sudo[102093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:44 devstack sudo[102093]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504.0112990c-4eb3-4f7b-8d49-fb99da7c80fb" returned: 0 in 0.299s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:44 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0edae06b-b31b-4e26-8c13-fa05c9ee162f 1073741824" returned: 0 in 0.575s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-quobyte-0112990c-4eb3-4f7b-8d49-fb99da7c80fb" released by "_delete_snapshot" :: held 1.903s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-quobyte-ce9d1ab4-1e35-4d5a-817a-9db436d85504" released by "delete_snapshot" :: held 1.946s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0edae06b-b31b-4e26-8c13-fa05c9ee162f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Created reservations ['00f46230-0278-4437-8ea0-38609e412743', '50714799-2472-4b40-a316-093aacbdc096', '6ff5bc78-e558-4ef9-b222-61a5ed87e907', 'f01e4711-ee1a-45d7-b36d-5bb65569bab1'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:44 devstack sudo[102099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0edae06b-b31b-4e26-8c13-fa05c9ee162f Sep 01 02:10:44 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:44 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Delete snapshot completed successfully. Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-0112990c-4eb3-4f7b-8d49-fb99da7c80fb-delete_snapshot" released by "delete_snapshot" :: held 2.199s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Snapshots deleted, issuing volume delete {{(pid=87128) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Acquiring lock "cinder-quobyte-ce9d1ab4-1e35-4d5a-817a-9db436d85504" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-quobyte-ce9d1ab4-1e35-4d5a-817a-9db436d85504" acquired by "delete_volume" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ce01d7-a03a-46d6-bac8-8eb69930f772]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:44 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504 Sep 01 02:10:44 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:44 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0edae06b-b31b-4e26-8c13-fa05c9ee162f" returned: 0 in 0.361s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.736s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-90891551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e623a76-80c5-4eef-b463-5d5e7128ff12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11fc2c2b97c42e58255873bee0ddaaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:40Z,use_quota=True,user_id='0f771f2af5d14b029aa971b1d2ec44e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] Creating volume 1e623a76-80c5-4eef-b463-5d5e7128ff12 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:10:44 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1e623a76-80c5-4eef-b463-5d5e7128ff12 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:44 devstack sudo[102104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1e623a76-80c5-4eef-b463-5d5e7128ff12 1073741824 Sep 01 02:10:44 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd25c196-3251-4ff6-9cab-86f0af131e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0edae06b-b31b-4e26-8c13-fa05c9ee162f', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fea06f2-4b38-4573-9ae3-66121676209e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:44 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] Volume volume-0edae06b-b31b-4e26-8c13-fa05c9ee162f (0edae06b-b31b-4e26-8c13-fa05c9ee162f): created successfully Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fea06f2-4b38-4573-9ae3-66121676209e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] Flow 'volume_create_manager' (245ec047-9a9e-460c-b3d2-33512f2d92f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:44 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-7bb255e8-c2a6-464d-82aa-6980f68d655e tempest-CreateVolumesFromImageTest-947157763 None] Created volume successfully. Sep 01 02:10:44 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504" returned: 0 in 0.439s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:44 devstack sudo[102111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504 Sep 01 02:10:44 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:45 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1e623a76-80c5-4eef-b463-5d5e7128ff12 1073741824" returned: 0 in 0.548s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:45 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ce9d1ab4-1e35-4d5a-817a-9db436d85504" returned: 0 in 0.355s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1e623a76-80c5-4eef-b463-5d5e7128ff12 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:45 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-quobyte-ce9d1ab4-1e35-4d5a-817a-9db436d85504" released by "delete_volume" :: held 0.884s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:45 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1e623a76-80c5-4eef-b463-5d5e7128ff12 Sep 01 02:10:45 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:45 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Created reservations ['c4c48a3f-98ea-4f2a-9b26-6623d7ac6078', '2cb3802c-8f58-4458-9270-2cdcea038d33', '08be457d-40d2-42de-8433-ca1e12c04793', 'ded2ea2b-b06a-4240-a0df-dffd47c82aea'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:45 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:45 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:45 devstack sudo[102117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:10:45 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:45 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1e623a76-80c5-4eef-b463-5d5e7128ff12" returned: 0 in 0.304s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:45 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:10:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:45 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-b6c02d65-4e9a-414b-910e-3ebc66523972 req-e4013c20-e078-4296-a7d2-93c6e5733ead tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Terminate volume connection completed successfully. Sep 01 02:10:45 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-b6c02d65-4e9a-414b-910e-3ebc66523972 req-e4013c20-e078-4296-a7d2-93c6e5733ead tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Deleting attachment 56a45b2c-6835-4761-a02f-7215147450a2. {{(pid=87128) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:10:45 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0afc3ff1-a07a-4b4e-a062-04058634a1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e623a76-80c5-4eef-b463-5d5e7128ff12', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:45 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4130ef46-5fb4-45c6-b098-a41b53eea325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:45 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] Volume volume-1e623a76-80c5-4eef-b463-5d5e7128ff12 (1e623a76-80c5-4eef-b463-5d5e7128ff12): created successfully Sep 01 02:10:45 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4130ef46-5fb4-45c6-b098-a41b53eea325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:45 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] Flow 'volume_create_manager' (7fe6bd6e-f818-448d-b515-41554038db08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:45 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-dc450ad1-4263-4fed-9cc4-6383a1946918 tempest-CreateVolumesFromImageTest-947157763 None] Created volume successfully. Sep 01 02:10:45 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.288s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:45 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:45 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Deleted volume successfully. Sep 01 02:10:45 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ce6f45b2-90f6-427e-9984-a8fe74344176 tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-ce9d1ab4-1e35-4d5a-817a-9db436d85504-delete_volume" released by "delete_volume" :: held 3.647s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b70a2620-c5b5-488a-a4e5-11d3c7c76529 tempest-CreateVolumesFromImageTest-947157763 None] Acquiring lock "cinder-1e623a76-80c5-4eef-b463-5d5e7128ff12-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b70a2620-c5b5-488a-a4e5-11d3c7c76529 tempest-CreateVolumesFromImageTest-947157763 None] Lock "cinder-1e623a76-80c5-4eef-b463-5d5e7128ff12-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-eab683b8-a684-427d-a90e-65301b0b930f tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Acquiring lock "cinder-ac272c69-044a-4d37-bf55-db1fd89f9d27-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b70a2620-c5b5-488a-a4e5-11d3c7c76529 tempest-CreateVolumesFromImageTest-947157763 None] Acquiring lock "cinder-quobyte-1e623a76-80c5-4eef-b463-5d5e7128ff12" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-eab683b8-a684-427d-a90e-65301b0b930f tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Lock "cinder-ac272c69-044a-4d37-bf55-db1fd89f9d27-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b70a2620-c5b5-488a-a4e5-11d3c7c76529 tempest-CreateVolumesFromImageTest-947157763 None] Lock "cinder-quobyte-1e623a76-80c5-4eef-b463-5d5e7128ff12" acquired by "delete_volume" :: waited 0.027s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:46 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f888cc-e6d1-4942-9f8f-1f9166485a12]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b70a2620-c5b5-488a-a4e5-11d3c7c76529 tempest-CreateVolumesFromImageTest-947157763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1e623a76-80c5-4eef-b463-5d5e7128ff12 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-eab683b8-a684-427d-a90e-65301b0b930f tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Acquiring lock "cinder-quobyte-ac272c69-044a-4d37-bf55-db1fd89f9d27" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-eab683b8-a684-427d-a90e-65301b0b930f tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Lock "cinder-quobyte-ac272c69-044a-4d37-bf55-db1fd89f9d27" acquired by "delete_volume" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:46 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde7e3d0-027b-422a-813d-f912a4c35de0]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eab683b8-a684-427d-a90e-65301b0b930f tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ac272c69-044a-4d37-bf55-db1fd89f9d27 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3916ddc2-1cbe-4f61-83ef-9d0190c5de2c tempest-VolumesDeleteCascade-536606026 None] Acquiring lock "cinder-b062f29e-552d-43b1-8b85-75b569d41c07-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:46 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1e623a76-80c5-4eef-b463-5d5e7128ff12 Sep 01 02:10:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3916ddc2-1cbe-4f61-83ef-9d0190c5de2c tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-b062f29e-552d-43b1-8b85-75b569d41c07-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:46 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:46 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ac272c69-044a-4d37-bf55-db1fd89f9d27 Sep 01 02:10:46 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3916ddc2-1cbe-4f61-83ef-9d0190c5de2c tempest-VolumesDeleteCascade-536606026 None] Acquiring lock "cinder-quobyte-b062f29e-552d-43b1-8b85-75b569d41c07" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3916ddc2-1cbe-4f61-83ef-9d0190c5de2c tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-quobyte-b062f29e-552d-43b1-8b85-75b569d41c07" acquired by "delete_volume" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:46 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[2654e0e0-fe90-4e3a-8622-d7cbd7916070]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3916ddc2-1cbe-4f61-83ef-9d0190c5de2c tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b062f29e-552d-43b1-8b85-75b569d41c07 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:46 devstack sudo[102152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b062f29e-552d-43b1-8b85-75b569d41c07 Sep 01 02:10:46 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:47 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:47 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eab683b8-a684-427d-a90e-65301b0b930f tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ac272c69-044a-4d37-bf55-db1fd89f9d27" returned: 0 in 0.411s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eab683b8-a684-427d-a90e-65301b0b930f tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ac272c69-044a-4d37-bf55-db1fd89f9d27 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b70a2620-c5b5-488a-a4e5-11d3c7c76529 tempest-CreateVolumesFromImageTest-947157763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1e623a76-80c5-4eef-b463-5d5e7128ff12" returned: 0 in 0.484s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b70a2620-c5b5-488a-a4e5-11d3c7c76529 tempest-CreateVolumesFromImageTest-947157763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1e623a76-80c5-4eef-b463-5d5e7128ff12 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:47 devstack sudo[102160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ac272c69-044a-4d37-bf55-db1fd89f9d27 Sep 01 02:10:47 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:47 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1e623a76-80c5-4eef-b463-5d5e7128ff12 Sep 01 02:10:47 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:47 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3916ddc2-1cbe-4f61-83ef-9d0190c5de2c tempest-VolumesDeleteCascade-536606026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b062f29e-552d-43b1-8b85-75b569d41c07" returned: 0 in 0.394s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3916ddc2-1cbe-4f61-83ef-9d0190c5de2c tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b062f29e-552d-43b1-8b85-75b569d41c07 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:47 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b062f29e-552d-43b1-8b85-75b569d41c07 Sep 01 02:10:47 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:47 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eab683b8-a684-427d-a90e-65301b0b930f tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ac272c69-044a-4d37-bf55-db1fd89f9d27" returned: 0 in 0.276s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-eab683b8-a684-427d-a90e-65301b0b930f tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Lock "cinder-quobyte-ac272c69-044a-4d37-bf55-db1fd89f9d27" released by "delete_volume" :: held 0.737s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:47 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b70a2620-c5b5-488a-a4e5-11d3c7c76529 tempest-CreateVolumesFromImageTest-947157763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1e623a76-80c5-4eef-b463-5d5e7128ff12" returned: 0 in 0.317s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b70a2620-c5b5-488a-a4e5-11d3c7c76529 tempest-CreateVolumesFromImageTest-947157763 None] Lock "cinder-quobyte-1e623a76-80c5-4eef-b463-5d5e7128ff12" released by "delete_volume" :: held 0.858s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-eab683b8-a684-427d-a90e-65301b0b930f tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Created reservations ['43cd8345-1d85-4bbe-8f01-d19f05d0354b', '4fc529e8-865e-4279-85d4-5de74236c169', 'd5e1b412-3d3a-404c-8a38-c0287af3be04', 'f74326f3-3e03-4ac9-9122-57e9f82b888e'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-b70a2620-c5b5-488a-a4e5-11d3c7c76529 tempest-CreateVolumesFromImageTest-947157763 None] Created reservations ['6c3050ba-54e7-4220-a13b-a1fed143bef0', '475168c2-598c-4633-82dc-57163e275a12', 'b04fd03f-9a81-41d9-923e-67b0f54f26dd', '32464eb5-1997-4b1d-bae0-99c50cf84e84'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:47 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3916ddc2-1cbe-4f61-83ef-9d0190c5de2c tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b062f29e-552d-43b1-8b85-75b569d41c07" returned: 0 in 0.280s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3916ddc2-1cbe-4f61-83ef-9d0190c5de2c tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-quobyte-b062f29e-552d-43b1-8b85-75b569d41c07" released by "delete_volume" :: held 0.730s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-eab683b8-a684-427d-a90e-65301b0b930f tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-eab683b8-a684-427d-a90e-65301b0b930f tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-eab683b8-a684-427d-a90e-65301b0b930f tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-eab683b8-a684-427d-a90e-65301b0b930f tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-eab683b8-a684-427d-a90e-65301b0b930f tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eab683b8-a684-427d-a90e-65301b0b930f tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:47 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:10:47 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b70a2620-c5b5-488a-a4e5-11d3c7c76529 tempest-CreateVolumesFromImageTest-947157763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b70a2620-c5b5-488a-a4e5-11d3c7c76529 tempest-CreateVolumesFromImageTest-947157763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b70a2620-c5b5-488a-a4e5-11d3c7c76529 tempest-CreateVolumesFromImageTest-947157763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b70a2620-c5b5-488a-a4e5-11d3c7c76529 tempest-CreateVolumesFromImageTest-947157763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b70a2620-c5b5-488a-a4e5-11d3c7c76529 tempest-CreateVolumesFromImageTest-947157763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b70a2620-c5b5-488a-a4e5-11d3c7c76529 tempest-CreateVolumesFromImageTest-947157763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-3916ddc2-1cbe-4f61-83ef-9d0190c5de2c tempest-VolumesDeleteCascade-536606026 None] Created reservations ['d1eb36a6-ed51-497e-968c-527d8a8ccebf', '707d7c04-0107-4b21-a402-25c692a14223', 'a2e17ba5-fb25-4f6a-a9e0-e38bd9b95a53', '23cd3cd1-7548-4075-bee6-a11c843c326f'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-616a634d-3f55-435b-85ce-3322f9d0414e tempest-CreateVolumesFromImageTest-947157763 None] Acquiring lock "cinder-0edae06b-b31b-4e26-8c13-fa05c9ee162f-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:47 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:10:47 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-616a634d-3f55-435b-85ce-3322f9d0414e tempest-CreateVolumesFromImageTest-947157763 None] Lock "cinder-0edae06b-b31b-4e26-8c13-fa05c9ee162f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-616a634d-3f55-435b-85ce-3322f9d0414e tempest-CreateVolumesFromImageTest-947157763 None] Acquiring lock "cinder-quobyte-0edae06b-b31b-4e26-8c13-fa05c9ee162f" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3916ddc2-1cbe-4f61-83ef-9d0190c5de2c tempest-VolumesDeleteCascade-536606026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3916ddc2-1cbe-4f61-83ef-9d0190c5de2c tempest-VolumesDeleteCascade-536606026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3916ddc2-1cbe-4f61-83ef-9d0190c5de2c tempest-VolumesDeleteCascade-536606026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3916ddc2-1cbe-4f61-83ef-9d0190c5de2c tempest-VolumesDeleteCascade-536606026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3916ddc2-1cbe-4f61-83ef-9d0190c5de2c tempest-VolumesDeleteCascade-536606026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3916ddc2-1cbe-4f61-83ef-9d0190c5de2c tempest-VolumesDeleteCascade-536606026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:47 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-616a634d-3f55-435b-85ce-3322f9d0414e tempest-CreateVolumesFromImageTest-947157763 None] Lock "cinder-quobyte-0edae06b-b31b-4e26-8c13-fa05c9ee162f" acquired by "delete_volume" :: waited 0.074s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:47 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:10:48 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:48 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5518db-c163-42dc-985e-6c77182ca772]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-616a634d-3f55-435b-85ce-3322f9d0414e tempest-CreateVolumesFromImageTest-947157763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0edae06b-b31b-4e26-8c13-fa05c9ee162f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:48 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b70a2620-c5b5-488a-a4e5-11d3c7c76529 tempest-CreateVolumesFromImageTest-947157763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.458s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:48 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-b70a2620-c5b5-488a-a4e5-11d3c7c76529 tempest-CreateVolumesFromImageTest-947157763 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:48 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-b70a2620-c5b5-488a-a4e5-11d3c7c76529 tempest-CreateVolumesFromImageTest-947157763 None] Deleted volume successfully. Sep 01 02:10:48 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eab683b8-a684-427d-a90e-65301b0b930f tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.583s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:48 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-eab683b8-a684-427d-a90e-65301b0b930f tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:48 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-eab683b8-a684-427d-a90e-65301b0b930f tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Deleted volume successfully. Sep 01 02:10:48 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b70a2620-c5b5-488a-a4e5-11d3c7c76529 tempest-CreateVolumesFromImageTest-947157763 None] Lock "cinder-1e623a76-80c5-4eef-b463-5d5e7128ff12-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:48 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-eab683b8-a684-427d-a90e-65301b0b930f tempest-TestServerVolumeAttachScenarioOldVersion-223656171 None] Lock "cinder-ac272c69-044a-4d37-bf55-db1fd89f9d27-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:48 devstack sudo[102179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0edae06b-b31b-4e26-8c13-fa05c9ee162f Sep 01 02:10:48 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:48 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3916ddc2-1cbe-4f61-83ef-9d0190c5de2c tempest-VolumesDeleteCascade-536606026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.647s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:48 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-3916ddc2-1cbe-4f61-83ef-9d0190c5de2c tempest-VolumesDeleteCascade-536606026 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:48 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-3916ddc2-1cbe-4f61-83ef-9d0190c5de2c tempest-VolumesDeleteCascade-536606026 None] Deleted volume successfully. Sep 01 02:10:48 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3916ddc2-1cbe-4f61-83ef-9d0190c5de2c tempest-VolumesDeleteCascade-536606026 None] Lock "cinder-b062f29e-552d-43b1-8b85-75b569d41c07-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:48 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-616a634d-3f55-435b-85ce-3322f9d0414e tempest-CreateVolumesFromImageTest-947157763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0edae06b-b31b-4e26-8c13-fa05c9ee162f" returned: 0 in 0.726s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-616a634d-3f55-435b-85ce-3322f9d0414e tempest-CreateVolumesFromImageTest-947157763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0edae06b-b31b-4e26-8c13-fa05c9ee162f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:48 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0edae06b-b31b-4e26-8c13-fa05c9ee162f Sep 01 02:10:48 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:49 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-616a634d-3f55-435b-85ce-3322f9d0414e tempest-CreateVolumesFromImageTest-947157763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0edae06b-b31b-4e26-8c13-fa05c9ee162f" returned: 0 in 0.343s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-616a634d-3f55-435b-85ce-3322f9d0414e tempest-CreateVolumesFromImageTest-947157763 None] Lock "cinder-quobyte-0edae06b-b31b-4e26-8c13-fa05c9ee162f" released by "delete_volume" :: held 1.171s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:49 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-616a634d-3f55-435b-85ce-3322f9d0414e tempest-CreateVolumesFromImageTest-947157763 None] Created reservations ['4e9609fb-9edb-4a1a-a082-60653d2d671e', '48e5dda2-a1df-49fb-aa5c-c190ecf31b4a', 'dc525862-ecfb-4030-8a7d-a0ab7b1341ff', 'e55c9662-7d69-464e-a6fc-ce6eb503c80c'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-616a634d-3f55-435b-85ce-3322f9d0414e tempest-CreateVolumesFromImageTest-947157763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-616a634d-3f55-435b-85ce-3322f9d0414e tempest-CreateVolumesFromImageTest-947157763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-616a634d-3f55-435b-85ce-3322f9d0414e tempest-CreateVolumesFromImageTest-947157763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-616a634d-3f55-435b-85ce-3322f9d0414e tempest-CreateVolumesFromImageTest-947157763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-616a634d-3f55-435b-85ce-3322f9d0414e tempest-CreateVolumesFromImageTest-947157763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-616a634d-3f55-435b-85ce-3322f9d0414e tempest-CreateVolumesFromImageTest-947157763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:49 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:10:49 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:49 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-616a634d-3f55-435b-85ce-3322f9d0414e tempest-CreateVolumesFromImageTest-947157763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.339s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:49 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-616a634d-3f55-435b-85ce-3322f9d0414e tempest-CreateVolumesFromImageTest-947157763 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:49 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-616a634d-3f55-435b-85ce-3322f9d0414e tempest-CreateVolumesFromImageTest-947157763 None] Deleted volume successfully. Sep 01 02:10:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-616a634d-3f55-435b-85ce-3322f9d0414e tempest-CreateVolumesFromImageTest-947157763 None] Lock "cinder-0edae06b-b31b-4e26-8c13-fa05c9ee162f-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-cd87a0c2-66df-455b-b6ab-644067c37147 tempest-CreateVolumesFromImageTest-947157763 None] Acquiring lock "cinder-a355e30e-e6b4-4460-bfd5-8a69115ec9c3-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-cd87a0c2-66df-455b-b6ab-644067c37147 tempest-CreateVolumesFromImageTest-947157763 None] Lock "cinder-a355e30e-e6b4-4460-bfd5-8a69115ec9c3-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-cd87a0c2-66df-455b-b6ab-644067c37147 tempest-CreateVolumesFromImageTest-947157763 None] Acquiring lock "cinder-quobyte-a355e30e-e6b4-4460-bfd5-8a69115ec9c3" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-cd87a0c2-66df-455b-b6ab-644067c37147 tempest-CreateVolumesFromImageTest-947157763 None] Lock "cinder-quobyte-a355e30e-e6b4-4460-bfd5-8a69115ec9c3" acquired by "delete_volume" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:50 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[2822b3c8-8aaa-4378-9b20-fef909e4e445]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cd87a0c2-66df-455b-b6ab-644067c37147 tempest-CreateVolumesFromImageTest-947157763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a355e30e-e6b4-4460-bfd5-8a69115ec9c3 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:50 devstack sudo[102217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a355e30e-e6b4-4460-bfd5-8a69115ec9c3 Sep 01 02:10:50 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:50 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cd87a0c2-66df-455b-b6ab-644067c37147 tempest-CreateVolumesFromImageTest-947157763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a355e30e-e6b4-4460-bfd5-8a69115ec9c3" returned: 0 in 0.473s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cd87a0c2-66df-455b-b6ab-644067c37147 tempest-CreateVolumesFromImageTest-947157763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a355e30e-e6b4-4460-bfd5-8a69115ec9c3 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:50 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a355e30e-e6b4-4460-bfd5-8a69115ec9c3 Sep 01 02:10:50 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:51 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cd87a0c2-66df-455b-b6ab-644067c37147 tempest-CreateVolumesFromImageTest-947157763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a355e30e-e6b4-4460-bfd5-8a69115ec9c3" returned: 0 in 0.267s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-cd87a0c2-66df-455b-b6ab-644067c37147 tempest-CreateVolumesFromImageTest-947157763 None] Lock "cinder-quobyte-a355e30e-e6b4-4460-bfd5-8a69115ec9c3" released by "delete_volume" :: held 0.784s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:51 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-cd87a0c2-66df-455b-b6ab-644067c37147 tempest-CreateVolumesFromImageTest-947157763 None] Created reservations ['5a753d4e-76a0-4d32-9101-5ce0fa3a9095', 'f4247cea-4bde-4bf4-b443-d3ca3424b10c', '5a5944c6-4f11-46d7-bc46-c301adffac48', '596e9d80-17a8-4639-acdd-827e031f6e7c'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cd87a0c2-66df-455b-b6ab-644067c37147 tempest-CreateVolumesFromImageTest-947157763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cd87a0c2-66df-455b-b6ab-644067c37147 tempest-CreateVolumesFromImageTest-947157763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:51 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cd87a0c2-66df-455b-b6ab-644067c37147 tempest-CreateVolumesFromImageTest-947157763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:51 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cd87a0c2-66df-455b-b6ab-644067c37147 tempest-CreateVolumesFromImageTest-947157763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cd87a0c2-66df-455b-b6ab-644067c37147 tempest-CreateVolumesFromImageTest-947157763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cd87a0c2-66df-455b-b6ab-644067c37147 tempest-CreateVolumesFromImageTest-947157763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:51 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:10:51 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:51 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cd87a0c2-66df-455b-b6ab-644067c37147 tempest-CreateVolumesFromImageTest-947157763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.262s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:51 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-cd87a0c2-66df-455b-b6ab-644067c37147 tempest-CreateVolumesFromImageTest-947157763 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:51 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-cd87a0c2-66df-455b-b6ab-644067c37147 tempest-CreateVolumesFromImageTest-947157763 None] Deleted volume successfully. Sep 01 02:10:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-19db2c6d-1c52-491c-9854-5b9f9ffabce7 tempest-CreateVolumesFromImageTest-947157763 None] Acquiring lock "cinder-19055d6c-2ec7-4405-ad43-320572c153c8-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-cd87a0c2-66df-455b-b6ab-644067c37147 tempest-CreateVolumesFromImageTest-947157763 None] Lock "cinder-a355e30e-e6b4-4460-bfd5-8a69115ec9c3-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-19db2c6d-1c52-491c-9854-5b9f9ffabce7 tempest-CreateVolumesFromImageTest-947157763 None] Lock "cinder-19055d6c-2ec7-4405-ad43-320572c153c8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-19db2c6d-1c52-491c-9854-5b9f9ffabce7 tempest-CreateVolumesFromImageTest-947157763 None] Acquiring lock "cinder-quobyte-19055d6c-2ec7-4405-ad43-320572c153c8" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-19db2c6d-1c52-491c-9854-5b9f9ffabce7 tempest-CreateVolumesFromImageTest-947157763 None] Lock "cinder-quobyte-19055d6c-2ec7-4405-ad43-320572c153c8" acquired by "delete_volume" :: waited 0.027s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:51 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d65ef2-8453-448e-90c1-492f524ff6b1]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-19db2c6d-1c52-491c-9854-5b9f9ffabce7 tempest-CreateVolumesFromImageTest-947157763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19055d6c-2ec7-4405-ad43-320572c153c8 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:52 devstack sudo[102229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19055d6c-2ec7-4405-ad43-320572c153c8 Sep 01 02:10:52 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:52 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-19db2c6d-1c52-491c-9854-5b9f9ffabce7 tempest-CreateVolumesFromImageTest-947157763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19055d6c-2ec7-4405-ad43-320572c153c8" returned: 0 in 0.449s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-19db2c6d-1c52-491c-9854-5b9f9ffabce7 tempest-CreateVolumesFromImageTest-947157763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19055d6c-2ec7-4405-ad43-320572c153c8 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:52 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19055d6c-2ec7-4405-ad43-320572c153c8 Sep 01 02:10:52 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:52 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-19db2c6d-1c52-491c-9854-5b9f9ffabce7 tempest-CreateVolumesFromImageTest-947157763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19055d6c-2ec7-4405-ad43-320572c153c8" returned: 0 in 0.309s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-19db2c6d-1c52-491c-9854-5b9f9ffabce7 tempest-CreateVolumesFromImageTest-947157763 None] Lock "cinder-quobyte-19055d6c-2ec7-4405-ad43-320572c153c8" released by "delete_volume" :: held 0.820s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:52 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-19db2c6d-1c52-491c-9854-5b9f9ffabce7 tempest-CreateVolumesFromImageTest-947157763 None] Created reservations ['b93e2bdb-3e47-4554-b634-bf88b31c6187', '8accd496-63bd-43d5-920c-83a1bd70dcf2', '5a221ee3-39d2-4978-bfde-916e00199a32', 'e034f071-0078-4b07-b789-62169815007d'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-19db2c6d-1c52-491c-9854-5b9f9ffabce7 tempest-CreateVolumesFromImageTest-947157763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-19db2c6d-1c52-491c-9854-5b9f9ffabce7 tempest-CreateVolumesFromImageTest-947157763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:52 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-19db2c6d-1c52-491c-9854-5b9f9ffabce7 tempest-CreateVolumesFromImageTest-947157763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:52 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-19db2c6d-1c52-491c-9854-5b9f9ffabce7 tempest-CreateVolumesFromImageTest-947157763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-19db2c6d-1c52-491c-9854-5b9f9ffabce7 tempest-CreateVolumesFromImageTest-947157763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-19db2c6d-1c52-491c-9854-5b9f9ffabce7 tempest-CreateVolumesFromImageTest-947157763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:52 devstack sudo[102237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:10:52 devstack sudo[102237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ef84ad25-3198-46f0-8a75-961936c268ae tempest-CreateVolumesFromImageTest-947157763 None] Acquiring lock "cinder-6442afd6-d83a-43bd-8ca3-ec7eec9b79a5-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ef84ad25-3198-46f0-8a75-961936c268ae tempest-CreateVolumesFromImageTest-947157763 None] Lock "cinder-6442afd6-d83a-43bd-8ca3-ec7eec9b79a5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ef84ad25-3198-46f0-8a75-961936c268ae tempest-CreateVolumesFromImageTest-947157763 None] Acquiring lock "cinder-quobyte-6442afd6-d83a-43bd-8ca3-ec7eec9b79a5" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ef84ad25-3198-46f0-8a75-961936c268ae tempest-CreateVolumesFromImageTest-947157763 None] Lock "cinder-quobyte-6442afd6-d83a-43bd-8ca3-ec7eec9b79a5" acquired by "delete_volume" :: waited 0.025s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:53 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[e261a134-e0c9-4b1f-919c-3ce36238eeb6]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ef84ad25-3198-46f0-8a75-961936c268ae tempest-CreateVolumesFromImageTest-947157763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6442afd6-d83a-43bd-8ca3-ec7eec9b79a5 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:53 devstack sudo[102237]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-19db2c6d-1c52-491c-9854-5b9f9ffabce7 tempest-CreateVolumesFromImageTest-947157763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.388s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:53 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-19db2c6d-1c52-491c-9854-5b9f9ffabce7 tempest-CreateVolumesFromImageTest-947157763 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:53 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-19db2c6d-1c52-491c-9854-5b9f9ffabce7 tempest-CreateVolumesFromImageTest-947157763 None] Deleted volume successfully. Sep 01 02:10:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-19db2c6d-1c52-491c-9854-5b9f9ffabce7 tempest-CreateVolumesFromImageTest-947157763 None] Lock "cinder-19055d6c-2ec7-4405-ad43-320572c153c8-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:53 devstack sudo[102240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6442afd6-d83a-43bd-8ca3-ec7eec9b79a5 Sep 01 02:10:53 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:53 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ef84ad25-3198-46f0-8a75-961936c268ae tempest-CreateVolumesFromImageTest-947157763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6442afd6-d83a-43bd-8ca3-ec7eec9b79a5" returned: 0 in 0.457s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ef84ad25-3198-46f0-8a75-961936c268ae tempest-CreateVolumesFromImageTest-947157763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6442afd6-d83a-43bd-8ca3-ec7eec9b79a5 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:53 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6442afd6-d83a-43bd-8ca3-ec7eec9b79a5 Sep 01 02:10:53 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:53 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ef84ad25-3198-46f0-8a75-961936c268ae tempest-CreateVolumesFromImageTest-947157763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6442afd6-d83a-43bd-8ca3-ec7eec9b79a5" returned: 0 in 0.301s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ef84ad25-3198-46f0-8a75-961936c268ae tempest-CreateVolumesFromImageTest-947157763 None] Lock "cinder-quobyte-6442afd6-d83a-43bd-8ca3-ec7eec9b79a5" released by "delete_volume" :: held 0.834s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:53 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-ef84ad25-3198-46f0-8a75-961936c268ae tempest-CreateVolumesFromImageTest-947157763 None] Created reservations ['41458756-83ed-424c-bd0f-cf26adad9bfe', '02971099-f69f-464e-8a46-40f02e37b5d5', '74b14667-2c83-4987-95d2-0cebedf82f4a', 'fa4f7df2-5b52-46e8-850a-5d82a109fe16'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ef84ad25-3198-46f0-8a75-961936c268ae tempest-CreateVolumesFromImageTest-947157763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ef84ad25-3198-46f0-8a75-961936c268ae tempest-CreateVolumesFromImageTest-947157763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-ef84ad25-3198-46f0-8a75-961936c268ae tempest-CreateVolumesFromImageTest-947157763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-ef84ad25-3198-46f0-8a75-961936c268ae tempest-CreateVolumesFromImageTest-947157763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ef84ad25-3198-46f0-8a75-961936c268ae tempest-CreateVolumesFromImageTest-947157763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ef84ad25-3198-46f0-8a75-961936c268ae tempest-CreateVolumesFromImageTest-947157763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:54 devstack sudo[102249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:10:54 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:54 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ef84ad25-3198-46f0-8a75-961936c268ae tempest-CreateVolumesFromImageTest-947157763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.332s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-ef84ad25-3198-46f0-8a75-961936c268ae tempest-CreateVolumesFromImageTest-947157763 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:54 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-ef84ad25-3198-46f0-8a75-961936c268ae tempest-CreateVolumesFromImageTest-947157763 None] Deleted volume successfully. Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ef84ad25-3198-46f0-8a75-961936c268ae tempest-CreateVolumesFromImageTest-947157763 None] Lock "cinder-6442afd6-d83a-43bd-8ca3-ec7eec9b79a5-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] Flow 'volume_create_manager' (8a7a55a0-b238-4a08-bd75-0d970e206021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76541cd2-397d-42eb-b87f-0db4cb15df36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76541cd2-397d-42eb-b87f-0db4cb15df36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-888690492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d301a72b-2d83-40ff-ba6c-e50ad5587c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6e4c1fe5064adfaa5cf910d50b1583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:55Z,use_quota=True,user_id='5cf497468e4644fcb0845e0cc091c4c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7526cd-616a-40c4-999f-bdd485321cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7526cd-616a-40c4-999f-bdd485321cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97e4b575-5208-49cd-8b40-a85bc54e99ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97e4b575-5208-49cd-8b40-a85bc54e99ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd301a72b-2d83-40ff-ba6c-e50ad5587c50', 'volume_name': 'volume-d301a72b-2d83-40ff-ba6c-e50ad5587c50', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a72ac0ef-915e-4d7b-a117-065369821135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a72ac0ef-915e-4d7b-a117-065369821135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eb40398-57b1-4de2-a7b8-bd33d25fee6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:54 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] Volume d301a72b-2d83-40ff-ba6c-e50ad5587c50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d301a72b-2d83-40ff-ba6c-e50ad5587c50', 'volume_size': 1} Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-888690492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d301a72b-2d83-40ff-ba6c-e50ad5587c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6e4c1fe5064adfaa5cf910d50b1583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:55Z,use_quota=True,user_id='5cf497468e4644fcb0845e0cc091c4c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] Creating volume d301a72b-2d83-40ff-ba6c-e50ad5587c50 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:10:54 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:10:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d301a72b-2d83-40ff-ba6c-e50ad5587c50 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:54 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d301a72b-2d83-40ff-ba6c-e50ad5587c50 1073741824 Sep 01 02:10:54 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:55 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d301a72b-2d83-40ff-ba6c-e50ad5587c50 1073741824" returned: 0 in 0.566s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d301a72b-2d83-40ff-ba6c-e50ad5587c50 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:55 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d301a72b-2d83-40ff-ba6c-e50ad5587c50 Sep 01 02:10:55 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:55 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d301a72b-2d83-40ff-ba6c-e50ad5587c50" returned: 0 in 0.319s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:55 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:10:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:55 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eb40398-57b1-4de2-a7b8-bd33d25fee6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d301a72b-2d83-40ff-ba6c-e50ad5587c50', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:55 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (126b60fa-67ca-4d5f-8f7c-e62da6540e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:55 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] Volume volume-d301a72b-2d83-40ff-ba6c-e50ad5587c50 (d301a72b-2d83-40ff-ba6c-e50ad5587c50): created successfully Sep 01 02:10:55 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (126b60fa-67ca-4d5f-8f7c-e62da6540e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:55 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] Flow 'volume_create_manager' (8a7a55a0-b238-4a08-bd75-0d970e206021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:55 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-7a0b0e31-a920-4eba-8b59-848f9c1c2ce5 tempest-VolumesTransfersTest-1053541662 None] Created volume successfully. Sep 01 02:10:57 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-c2b1bfbf-3b75-49a8-bbd4-466a473636a7 tempest-VolumesTransfersTest-685357354 None] Transfer volume completed successfully. Sep 01 02:10:57 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Flow 'volume_create_manager' (d0435539-77e3-44fd-b19e-f63ea212b1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cd23945-61c2-47ff-94a4-c22ff78764f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cd23945-61c2-47ff-94a4-c22ff78764f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-846081707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a807691-ad91-4f75-b956-2d60a489e0c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59db0e904b0c4f5899120eb7abae1258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:58Z,use_quota=True,user_id='f523579ba6ff4e75a8de3b5e6e1410de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cef2336-a8dc-4dc4-9e0c-18e71208bf83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cef2336-a8dc-4dc4-9e0c-18e71208bf83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066f0c94-e129-416a-a7a5-30bc0def4354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066f0c94-e129-416a-a7a5-30bc0def4354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a807691-ad91-4f75-b956-2d60a489e0c5', 'volume_name': 'volume-8a807691-ad91-4f75-b956-2d60a489e0c5', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03de2f30-edaf-4c1a-8501-30509a455182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03de2f30-edaf-4c1a-8501-30509a455182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d2157e-5298-47d8-9d99-9b20fc6e4857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:57 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Volume 8a807691-ad91-4f75-b956-2d60a489e0c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a807691-ad91-4f75-b956-2d60a489e0c5', 'volume_size': 1} Sep 01 02:10:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-846081707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a807691-ad91-4f75-b956-2d60a489e0c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59db0e904b0c4f5899120eb7abae1258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:58Z,use_quota=True,user_id='f523579ba6ff4e75a8de3b5e6e1410de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:10:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Creating volume 8a807691-ad91-4f75-b956-2d60a489e0c5 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:10:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:10:57 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:10:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:57 devstack sudo[102264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5 1073741824 Sep 01 02:10:57 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:58 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-549adf54-990d-4740-9f82-1a4520197912 tempest-VolumesTransfersTest-1978462598 None] Acquiring lock "cinder-d301a72b-2d83-40ff-ba6c-e50ad5587c50-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:58 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-549adf54-990d-4740-9f82-1a4520197912 tempest-VolumesTransfersTest-1978462598 None] Lock "cinder-d301a72b-2d83-40ff-ba6c-e50ad5587c50-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:58 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5 1073741824" returned: 0 in 0.538s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:58 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-549adf54-990d-4740-9f82-1a4520197912 tempest-VolumesTransfersTest-1978462598 None] Acquiring lock "cinder-quobyte-d301a72b-2d83-40ff-ba6c-e50ad5587c50" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:58 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-549adf54-990d-4740-9f82-1a4520197912 tempest-VolumesTransfersTest-1978462598 None] Lock "cinder-quobyte-d301a72b-2d83-40ff-ba6c-e50ad5587c50" acquired by "delete_volume" :: waited 0.028s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:58 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[9483795e-3afa-4c4a-a63e-29ceec47e9b5]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-549adf54-990d-4740-9f82-1a4520197912 tempest-VolumesTransfersTest-1978462598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d301a72b-2d83-40ff-ba6c-e50ad5587c50 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:58 devstack sudo[102271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5 Sep 01 02:10:58 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:58 devstack sudo[102270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d301a72b-2d83-40ff-ba6c-e50ad5587c50 Sep 01 02:10:58 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:58 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5" returned: 0 in 0.324s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:10:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d2157e-5298-47d8-9d99-9b20fc6e4857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a807691-ad91-4f75-b956-2d60a489e0c5', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29327238-32a4-4632-b1ed-0cc84b87b2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:58 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Volume volume-8a807691-ad91-4f75-b956-2d60a489e0c5 (8a807691-ad91-4f75-b956-2d60a489e0c5): created successfully Sep 01 02:10:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29327238-32a4-4632-b1ed-0cc84b87b2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Flow 'volume_create_manager' (d0435539-77e3-44fd-b19e-f63ea212b1f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:58 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-78d14216-1dfe-4e6b-b241-3e8725df2f06 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Created volume successfully. Sep 01 02:10:58 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-549adf54-990d-4740-9f82-1a4520197912 tempest-VolumesTransfersTest-1978462598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d301a72b-2d83-40ff-ba6c-e50ad5587c50" returned: 0 in 0.434s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-549adf54-990d-4740-9f82-1a4520197912 tempest-VolumesTransfersTest-1978462598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d301a72b-2d83-40ff-ba6c-e50ad5587c50 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:59 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d301a72b-2d83-40ff-ba6c-e50ad5587c50 Sep 01 02:10:59 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:59 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-549adf54-990d-4740-9f82-1a4520197912 tempest-VolumesTransfersTest-1978462598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d301a72b-2d83-40ff-ba6c-e50ad5587c50" returned: 0 in 0.259s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:59 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-549adf54-990d-4740-9f82-1a4520197912 tempest-VolumesTransfersTest-1978462598 None] Lock "cinder-quobyte-d301a72b-2d83-40ff-ba6c-e50ad5587c50" released by "delete_volume" :: held 0.738s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:59 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-549adf54-990d-4740-9f82-1a4520197912 tempest-VolumesTransfersTest-1978462598 None] Created reservations ['56156778-1802-4c6f-95ec-a2e753b231dd', '4e14ad6d-7e0f-439c-8292-b13b77d6853b', '1bffc16d-dd27-411b-b3a0-79643b292386', 'f7032b02-2e6c-467d-b2dd-0004d4170629'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-549adf54-990d-4740-9f82-1a4520197912 tempest-VolumesTransfersTest-1978462598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-549adf54-990d-4740-9f82-1a4520197912 tempest-VolumesTransfersTest-1978462598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:59 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-549adf54-990d-4740-9f82-1a4520197912 tempest-VolumesTransfersTest-1978462598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:59 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-549adf54-990d-4740-9f82-1a4520197912 tempest-VolumesTransfersTest-1978462598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-549adf54-990d-4740-9f82-1a4520197912 tempest-VolumesTransfersTest-1978462598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-549adf54-990d-4740-9f82-1a4520197912 tempest-VolumesTransfersTest-1978462598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:59 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:10:59 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:59 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-549adf54-990d-4740-9f82-1a4520197912 tempest-VolumesTransfersTest-1978462598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.310s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:59 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-549adf54-990d-4740-9f82-1a4520197912 tempest-VolumesTransfersTest-1978462598 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:59 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-549adf54-990d-4740-9f82-1a4520197912 tempest-VolumesTransfersTest-1978462598 None] Deleted volume successfully. Sep 01 02:10:59 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-549adf54-990d-4740-9f82-1a4520197912 tempest-VolumesTransfersTest-1978462598 None] Lock "cinder-d301a72b-2d83-40ff-ba6c-e50ad5587c50-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ad62902d-d69a-4804-882c-4716966128a8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ad62902d-d69a-4804-882c-4716966128a8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:00 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-ad62902d-d69a-4804-882c-4716966128a8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Creating offline snapshot df720a1d-3537-46b9-b3c5-5116f66ac503 of volume 8a807691-ad91-4f75-b956-2d60a489e0c5 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:11:00 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:11:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] Flow 'volume_create_manager' (8a823791-fc13-4484-9670-a4a2d55a387a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (794dc30d-f3ac-4010-8a61-4daa627c8085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:00 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[5782fa0a-0588-4562-a778-057442fee9eb]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ad62902d-d69a-4804-882c-4716966128a8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (794dc30d-f3ac-4010-8a61-4daa627c8085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1376555977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45a475ce-fb2d-4660-bcc3-9903194ccee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6e4c1fe5064adfaa5cf910d50b1583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:00Z,use_quota=True,user_id='5cf497468e4644fcb0845e0cc091c4c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e4f099-77bb-41dd-8b3b-812a5f8550fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e4f099-77bb-41dd-8b3b-812a5f8550fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d32f4f-ccb8-4680-937d-dec115e662a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d32f4f-ccb8-4680-937d-dec115e662a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45a475ce-fb2d-4660-bcc3-9903194ccee7', 'volume_name': 'volume-45a475ce-fb2d-4660-bcc3-9903194ccee7', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c505323-d622-42a6-a7f7-46e4a89e5aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c505323-d622-42a6-a7f7-46e4a89e5aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffddd367-0a54-425e-8b2a-2b036a0a5f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:00 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] Volume 45a475ce-fb2d-4660-bcc3-9903194ccee7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45a475ce-fb2d-4660-bcc3-9903194ccee7', 'volume_size': 1} Sep 01 02:11:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:00 devstack sudo[102285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5 Sep 01 02:11:00 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:00 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ad62902d-d69a-4804-882c-4716966128a8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5" returned: 0 in 0.356s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ad62902d-d69a-4804-882c-4716966128a8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5.df720a1d-3537-46b9-b3c5-5116f66ac503 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:00 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5.df720a1d-3537-46b9-b3c5-5116f66ac503 1G Sep 01 02:11:00 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:01 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ad62902d-d69a-4804-882c-4716966128a8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5.df720a1d-3537-46b9-b3c5-5116f66ac503 1G" returned: 0 in 0.461s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ad62902d-d69a-4804-882c-4716966128a8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a807691-ad91-4f75-b956-2d60a489e0c5 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5.df720a1d-3537-46b9-b3c5-5116f66ac503 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:01 devstack sudo[102296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a807691-ad91-4f75-b956-2d60a489e0c5 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5.df720a1d-3537-46b9-b3c5-5116f66ac503 Sep 01 02:11:01 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:01 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ad62902d-d69a-4804-882c-4716966128a8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a807691-ad91-4f75-b956-2d60a489e0c5 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5.df720a1d-3537-46b9-b3c5-5116f66ac503" returned: 0 in 0.305s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:01 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-ad62902d-d69a-4804-882c-4716966128a8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5.df720a1d-3537-46b9-b3c5-5116f66ac503 is being set with open permissions: ugo+rw Sep 01 02:11:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ad62902d-d69a-4804-882c-4716966128a8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5.df720a1d-3537-46b9-b3c5-5116f66ac503 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:01 devstack sudo[102301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5.df720a1d-3537-46b9-b3c5-5116f66ac503 Sep 01 02:11:01 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:01 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ad62902d-d69a-4804-882c-4716966128a8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5.df720a1d-3537-46b9-b3c5-5116f66ac503" returned: 0 in 0.237s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ad62902d-d69a-4804-882c-4716966128a8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:01 devstack sudo[102305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5.info Sep 01 02:11:01 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:02 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ad62902d-d69a-4804-882c-4716966128a8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5.info" returned: 0 in 0.270s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:02 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-ad62902d-d69a-4804-882c-4716966128a8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5.info is being set with open permissions: ugo+rw Sep 01 02:11:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ad62902d-d69a-4804-882c-4716966128a8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:02 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5.info Sep 01 02:11:02 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:02 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ad62902d-d69a-4804-882c-4716966128a8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5.info" returned: 0 in 0.291s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ad62902d-d69a-4804-882c-4716966128a8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.063s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.932s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1376555977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45a475ce-fb2d-4660-bcc3-9903194ccee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6e4c1fe5064adfaa5cf910d50b1583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:00Z,use_quota=True,user_id='5cf497468e4644fcb0845e0cc091c4c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] Creating volume 45a475ce-fb2d-4660-bcc3-9903194ccee7 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:02 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:11:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-45a475ce-fb2d-4660-bcc3-9903194ccee7 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:02 devstack sudo[102311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-45a475ce-fb2d-4660-bcc3-9903194ccee7 1073741824 Sep 01 02:11:02 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:02 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-ad62902d-d69a-4804-882c-4716966128a8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Create snapshot completed successfully Sep 01 02:11:02 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-45a475ce-fb2d-4660-bcc3-9903194ccee7 1073741824" returned: 0 in 0.466s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-45a475ce-fb2d-4660-bcc3-9903194ccee7 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:02 devstack sudo[102317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-45a475ce-fb2d-4660-bcc3-9903194ccee7 Sep 01 02:11:02 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:03 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-45a475ce-fb2d-4660-bcc3-9903194ccee7" returned: 0 in 0.272s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:03 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffddd367-0a54-425e-8b2a-2b036a0a5f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45a475ce-fb2d-4660-bcc3-9903194ccee7', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f8120e-7c54-4f05-8f14-d97f24389423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:03 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] Volume volume-45a475ce-fb2d-4660-bcc3-9903194ccee7 (45a475ce-fb2d-4660-bcc3-9903194ccee7): created successfully Sep 01 02:11:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f8120e-7c54-4f05-8f14-d97f24389423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] Flow 'volume_create_manager' (8a823791-fc13-4484-9670-a4a2d55a387a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:03 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-7723f1a6-f47a-448f-9783-52ad37437404 tempest-VolumesTransfersTest-1053541662 None] Created volume successfully. Sep 01 02:11:03 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-31db50b8-7606-4653-97cc-8ccfe191e93c tempest-VolumesTransfersTest-1978462598 None] Acquiring lock "cinder-45a475ce-fb2d-4660-bcc3-9903194ccee7-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:03 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-31db50b8-7606-4653-97cc-8ccfe191e93c tempest-VolumesTransfersTest-1978462598 None] Lock "cinder-45a475ce-fb2d-4660-bcc3-9903194ccee7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:03 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-31db50b8-7606-4653-97cc-8ccfe191e93c tempest-VolumesTransfersTest-1978462598 None] Acquiring lock "cinder-quobyte-45a475ce-fb2d-4660-bcc3-9903194ccee7" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:03 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-31db50b8-7606-4653-97cc-8ccfe191e93c tempest-VolumesTransfersTest-1978462598 None] Lock "cinder-quobyte-45a475ce-fb2d-4660-bcc3-9903194ccee7" acquired by "delete_volume" :: waited 0.026s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:03 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe44d01-8e5a-4b71-a511-a64372be81b8]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-31db50b8-7606-4653-97cc-8ccfe191e93c tempest-VolumesTransfersTest-1978462598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-45a475ce-fb2d-4660-bcc3-9903194ccee7 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:03 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:11:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Flow 'volume_create_manager' (6592b60a-0ac8-4be1-ae3e-06616bd0db55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b84f3a-424b-4dc7-92c8-ceef259873e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b84f3a-424b-4dc7-92c8-ceef259873e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1713490176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a44b51e-1bff-430f-afde-4df4d74b860b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59db0e904b0c4f5899120eb7abae1258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:04Z,use_quota=True,user_id='f523579ba6ff4e75a8de3b5e6e1410de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b302e87d-365b-4617-9982-33d8d6ebce7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b302e87d-365b-4617-9982-33d8d6ebce7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd50020a-dd5e-4c05-9a69-f7034d1c3116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd50020a-dd5e-4c05-9a69-f7034d1c3116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a44b51e-1bff-430f-afde-4df4d74b860b', 'volume_name': 'volume-6a44b51e-1bff-430f-afde-4df4d74b860b', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350e243e-f5ea-47df-8a92-b04582a92e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350e243e-f5ea-47df-8a92-b04582a92e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (664c94bd-cc2a-4917-8221-78c0f0eb18a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:04 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Volume 6a44b51e-1bff-430f-afde-4df4d74b860b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a44b51e-1bff-430f-afde-4df4d74b860b', 'volume_size': 1} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:04 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-45a475ce-fb2d-4660-bcc3-9903194ccee7 Sep 01 02:11:04 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1713490176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a44b51e-1bff-430f-afde-4df4d74b860b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59db0e904b0c4f5899120eb7abae1258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:04Z,use_quota=True,user_id='f523579ba6ff4e75a8de3b5e6e1410de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Creating volume 6a44b51e-1bff-430f-afde-4df4d74b860b {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:04 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6a44b51e-1bff-430f-afde-4df4d74b860b 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:04 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6a44b51e-1bff-430f-afde-4df4d74b860b 1073741824 Sep 01 02:11:04 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Flow 'volume_create_manager' (28996526-3785-47bb-ba06-255e00138f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (917b60e6-9237-4084-9323-96d8dca2dc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (917b60e6-9237-4084-9323-96d8dca2dc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-226807178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8120d214-16e2-40e8-b103-79333c2c12e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59db0e904b0c4f5899120eb7abae1258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:04Z,use_quota=True,user_id='f523579ba6ff4e75a8de3b5e6e1410de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf8fd073-a27d-4e14-b408-9ec841aa055e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf8fd073-a27d-4e14-b408-9ec841aa055e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bbccf0f-2f54-46e7-a981-5c7cb7c93441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:04 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bbccf0f-2f54-46e7-a981-5c7cb7c93441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8120d214-16e2-40e8-b103-79333c2c12e6', 'volume_name': 'volume-8120d214-16e2-40e8-b103-79333c2c12e6', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34820acd-d188-4522-a462-f55a932b0846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34820acd-d188-4522-a462-f55a932b0846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb6e60d-d70c-49be-8458-7733ba79d451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:04 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Volume 8120d214-16e2-40e8-b103-79333c2c12e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8120d214-16e2-40e8-b103-79333c2c12e6', 'volume_size': 1} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-31db50b8-7606-4653-97cc-8ccfe191e93c tempest-VolumesTransfersTest-1978462598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-45a475ce-fb2d-4660-bcc3-9903194ccee7" returned: 0 in 0.534s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-31db50b8-7606-4653-97cc-8ccfe191e93c tempest-VolumesTransfersTest-1978462598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-45a475ce-fb2d-4660-bcc3-9903194ccee7 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:04 devstack sudo[102331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-45a475ce-fb2d-4660-bcc3-9903194ccee7 Sep 01 02:11:04 devstack sudo[102331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:04 devstack sudo[102331]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-31db50b8-7606-4653-97cc-8ccfe191e93c tempest-VolumesTransfersTest-1978462598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-45a475ce-fb2d-4660-bcc3-9903194ccee7" returned: 0 in 0.274s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-31db50b8-7606-4653-97cc-8ccfe191e93c tempest-VolumesTransfersTest-1978462598 None] Lock "cinder-quobyte-45a475ce-fb2d-4660-bcc3-9903194ccee7" released by "delete_volume" :: held 0.857s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:04 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6a44b51e-1bff-430f-afde-4df4d74b860b 1073741824" returned: 0 in 0.688s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-31db50b8-7606-4653-97cc-8ccfe191e93c tempest-VolumesTransfersTest-1978462598 None] Created reservations ['74eb001f-8256-476b-b5d6-2d7aa1c3634c', '0242b3af-13bb-4778-bd10-907d69e0c727', '7683d622-7552-4721-b8b9-e5b0d4e2fe95', '1bd6521a-04c6-4852-9884-b87d227d77fa'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6a44b51e-1bff-430f-afde-4df4d74b860b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:04 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6a44b51e-1bff-430f-afde-4df4d74b860b Sep 01 02:11:04 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Flow 'volume_create_manager' (b82d621b-4402-4315-8ddd-27b5086a5cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f04064a-79ed-4073-a9bd-0b2876e870e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f04064a-79ed-4073-a9bd-0b2876e870e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-369904805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78ffca8-c589-4417-8695-d83c14e5266e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59db0e904b0c4f5899120eb7abae1258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:05Z,use_quota=True,user_id='f523579ba6ff4e75a8de3b5e6e1410de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0108f70-f81d-4bcc-81b1-68303837b332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0108f70-f81d-4bcc-81b1-68303837b332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ec3498f-5957-4e16-8c52-b622712a86b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ec3498f-5957-4e16-8c52-b622712a86b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd78ffca8-c589-4417-8695-d83c14e5266e', 'volume_name': 'volume-d78ffca8-c589-4417-8695-d83c14e5266e', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca9ee247-415e-4616-b85c-3abbbee575d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca9ee247-415e-4616-b85c-3abbbee575d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d540a5b-b5ed-4c0b-b3ef-fc1ffa791899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:05 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Volume d78ffca8-c589-4417-8695-d83c14e5266e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d78ffca8-c589-4417-8695-d83c14e5266e', 'volume_size': 1} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:05 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6a44b51e-1bff-430f-afde-4df4d74b860b" returned: 0 in 0.305s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.759s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-226807178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8120d214-16e2-40e8-b103-79333c2c12e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59db0e904b0c4f5899120eb7abae1258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:04Z,use_quota=True,user_id='f523579ba6ff4e75a8de3b5e6e1410de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Creating volume 8120d214-16e2-40e8-b103-79333c2c12e6 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:05 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8120d214-16e2-40e8-b103-79333c2c12e6 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (664c94bd-cc2a-4917-8221-78c0f0eb18a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a44b51e-1bff-430f-afde-4df4d74b860b', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29bc759a-55cc-4977-b103-f34a11b1b64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:05 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8120d214-16e2-40e8-b103-79333c2c12e6 1073741824 Sep 01 02:11:05 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-31db50b8-7606-4653-97cc-8ccfe191e93c tempest-VolumesTransfersTest-1978462598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-31db50b8-7606-4653-97cc-8ccfe191e93c tempest-VolumesTransfersTest-1978462598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-31db50b8-7606-4653-97cc-8ccfe191e93c tempest-VolumesTransfersTest-1978462598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-31db50b8-7606-4653-97cc-8ccfe191e93c tempest-VolumesTransfersTest-1978462598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-31db50b8-7606-4653-97cc-8ccfe191e93c tempest-VolumesTransfersTest-1978462598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-31db50b8-7606-4653-97cc-8ccfe191e93c tempest-VolumesTransfersTest-1978462598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:05 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Volume volume-6a44b51e-1bff-430f-afde-4df4d74b860b (6a44b51e-1bff-430f-afde-4df4d74b860b): created successfully Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29bc759a-55cc-4977-b103-f34a11b1b64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Flow 'volume_create_manager' (6592b60a-0ac8-4be1-ae3e-06616bd0db55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:05 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-a39daaa4-c7ed-4eac-ab90-b747a8a4709d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Created volume successfully. Sep 01 02:11:05 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:11:05 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Flow 'volume_create_manager' (cc4beb7c-3618-46e6-a60f-65778d9f86bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:05 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7040d1a4-b8be-432d-9568-fa215f691f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-31db50b8-7606-4653-97cc-8ccfe191e93c tempest-VolumesTransfersTest-1978462598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.395s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-31db50b8-7606-4653-97cc-8ccfe191e93c tempest-VolumesTransfersTest-1978462598 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:05 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-31db50b8-7606-4653-97cc-8ccfe191e93c tempest-VolumesTransfersTest-1978462598 None] Deleted volume successfully. Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7040d1a4-b8be-432d-9568-fa215f691f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1576787879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82c14283-2114-48e5-9056-9d5cfd3847fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59db0e904b0c4f5899120eb7abae1258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:06Z,use_quota=True,user_id='f523579ba6ff4e75a8de3b5e6e1410de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee4a9399-1bd6-4977-959c-fc9cb773d3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee4a9399-1bd6-4977-959c-fc9cb773d3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cae70a3d-1fdf-4c3c-bf96-dc6e1b182065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cae70a3d-1fdf-4c3c-bf96-dc6e1b182065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82c14283-2114-48e5-9056-9d5cfd3847fd', 'volume_name': 'volume-82c14283-2114-48e5-9056-9d5cfd3847fd', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae5fb47c-552d-493f-ab73-84bf4eb09475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae5fb47c-552d-493f-ab73-84bf4eb09475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32eacdc0-b134-4263-9d6c-cb0d48c21837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:05 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Volume 82c14283-2114-48e5-9056-9d5cfd3847fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82c14283-2114-48e5-9056-9d5cfd3847fd', 'volume_size': 1} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-31db50b8-7606-4653-97cc-8ccfe191e93c tempest-VolumesTransfersTest-1978462598 None] Lock "cinder-45a475ce-fb2d-4660-bcc3-9903194ccee7-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:05 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8120d214-16e2-40e8-b103-79333c2c12e6 1073741824" returned: 0 in 0.690s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8120d214-16e2-40e8-b103-79333c2c12e6 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:05 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8120d214-16e2-40e8-b103-79333c2c12e6 Sep 01 02:11:05 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Flow 'volume_create_manager' (fc94ea2d-b6de-4b33-84df-2fdbfe3a92e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79d856ac-bbc5-483d-afee-8f2c543549f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79d856ac-bbc5-483d-afee-8f2c543549f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-430897495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac89e73a-89cb-4500-b804-07b6b1c59abc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59db0e904b0c4f5899120eb7abae1258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:06Z,use_quota=True,user_id='f523579ba6ff4e75a8de3b5e6e1410de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0642be-859d-4fc1-93f9-d08c5b898f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0642be-859d-4fc1-93f9-d08c5b898f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac32a2ae-a6d9-4c71-b863-af1bb9719f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac32a2ae-a6d9-4c71-b863-af1bb9719f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac89e73a-89cb-4500-b804-07b6b1c59abc', 'volume_name': 'volume-ac89e73a-89cb-4500-b804-07b6b1c59abc', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86568792-1509-4514-930c-edca042b491f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86568792-1509-4514-930c-edca042b491f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a38b1052-3b4f-4474-99ac-eada1b4be698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:06 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Volume ac89e73a-89cb-4500-b804-07b6b1c59abc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac89e73a-89cb-4500-b804-07b6b1c59abc', 'volume_size': 1} Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:06 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8120d214-16e2-40e8-b103-79333c2c12e6" returned: 0 in 0.329s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.161s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-369904805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78ffca8-c589-4417-8695-d83c14e5266e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59db0e904b0c4f5899120eb7abae1258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:05Z,use_quota=True,user_id='f523579ba6ff4e75a8de3b5e6e1410de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Creating volume d78ffca8-c589-4417-8695-d83c14e5266e {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:06 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d78ffca8-c589-4417-8695-d83c14e5266e 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb6e60d-d70c-49be-8458-7733ba79d451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8120d214-16e2-40e8-b103-79333c2c12e6', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20fc15e9-061b-47c9-8029-959daa9f8631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:06 devstack sudo[102350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d78ffca8-c589-4417-8695-d83c14e5266e 1073741824 Sep 01 02:11:06 devstack sudo[102350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:06 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Volume volume-8120d214-16e2-40e8-b103-79333c2c12e6 (8120d214-16e2-40e8-b103-79333c2c12e6): created successfully Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20fc15e9-061b-47c9-8029-959daa9f8631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Flow 'volume_create_manager' (28996526-3785-47bb-ba06-255e00138f11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:06 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-39026630-afec-40cc-9a0d-3b65214f2097 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Created volume successfully. Sep 01 02:11:06 devstack sudo[102350]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d78ffca8-c589-4417-8695-d83c14e5266e 1073741824" returned: 0 in 0.515s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d78ffca8-c589-4417-8695-d83c14e5266e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:06 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d78ffca8-c589-4417-8695-d83c14e5266e Sep 01 02:11:06 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:07 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d78ffca8-c589-4417-8695-d83c14e5266e" returned: 0 in 0.308s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:07 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.457s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:07 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1576787879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82c14283-2114-48e5-9056-9d5cfd3847fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59db0e904b0c4f5899120eb7abae1258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:06Z,use_quota=True,user_id='f523579ba6ff4e75a8de3b5e6e1410de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:07 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Creating volume 82c14283-2114-48e5-9056-9d5cfd3847fd {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:07 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:07 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:07 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:07 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:11:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-82c14283-2114-48e5-9056-9d5cfd3847fd 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d540a5b-b5ed-4c0b-b3ef-fc1ffa791899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d78ffca8-c589-4417-8695-d83c14e5266e', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:07 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-82c14283-2114-48e5-9056-9d5cfd3847fd 1073741824 Sep 01 02:11:07 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bbd4199-b550-405b-8ae9-c864ebdb4836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:07 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Volume volume-d78ffca8-c589-4417-8695-d83c14e5266e (d78ffca8-c589-4417-8695-d83c14e5266e): created successfully Sep 01 02:11:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bbd4199-b550-405b-8ae9-c864ebdb4836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Flow 'volume_create_manager' (b82d621b-4402-4315-8ddd-27b5086a5cd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:07 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-d1ec3272-97fd-4ec8-bd8a-634d5b4b2fcd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Created volume successfully. Sep 01 02:11:07 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-82c14283-2114-48e5-9056-9d5cfd3847fd 1073741824" returned: 0 in 0.542s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-82c14283-2114-48e5-9056-9d5cfd3847fd {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:07 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-82c14283-2114-48e5-9056-9d5cfd3847fd Sep 01 02:11:07 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:08 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-82c14283-2114-48e5-9056-9d5cfd3847fd" returned: 0 in 0.256s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.831s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-430897495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac89e73a-89cb-4500-b804-07b6b1c59abc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59db0e904b0c4f5899120eb7abae1258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:06Z,use_quota=True,user_id='f523579ba6ff4e75a8de3b5e6e1410de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Creating volume ac89e73a-89cb-4500-b804-07b6b1c59abc {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:08 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:11:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ac89e73a-89cb-4500-b804-07b6b1c59abc 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32eacdc0-b134-4263-9d6c-cb0d48c21837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82c14283-2114-48e5-9056-9d5cfd3847fd', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af6fd981-35f8-4f86-a402-b1bb2ee8d136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:08 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ac89e73a-89cb-4500-b804-07b6b1c59abc 1073741824 Sep 01 02:11:08 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:08 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Volume volume-82c14283-2114-48e5-9056-9d5cfd3847fd (82c14283-2114-48e5-9056-9d5cfd3847fd): created successfully Sep 01 02:11:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af6fd981-35f8-4f86-a402-b1bb2ee8d136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Flow 'volume_create_manager' (cc4beb7c-3618-46e6-a60f-65778d9f86bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:08 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-39ccb64b-df49-44ce-a818-57b93689daf9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Created volume successfully. Sep 01 02:11:08 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ac89e73a-89cb-4500-b804-07b6b1c59abc 1073741824" returned: 0 in 0.567s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ac89e73a-89cb-4500-b804-07b6b1c59abc {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:08 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ac89e73a-89cb-4500-b804-07b6b1c59abc Sep 01 02:11:08 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:08 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=133,cinder:INSERT=44,cinder:UPDATE=192,cinder:DELETE=21 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] Flow 'volume_create_manager' (7aad06cf-9b44-427e-a2eb-4525f9a29b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:09 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334c5f27-387f-4876-ad4b-f9f3284d3491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ac89e73a-89cb-4500-b804-07b6b1c59abc" returned: 0 in 0.352s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334c5f27-387f-4876-ad4b-f9f3284d3491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-564993195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d1721ea-0bc1-469b-8423-ca81a212819c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49d8b707d5ae42138533af28a1c2e47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:09Z,use_quota=True,user_id='62135b8905134d639cec7d4c67e56f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4692e357-2263-4453-9162-786b552bb4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4692e357-2263-4453-9162-786b552bb4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7008a9f3-1b90-464c-b4b7-cdc5dcc933bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7008a9f3-1b90-464c-b4b7-cdc5dcc933bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d1721ea-0bc1-469b-8423-ca81a212819c', 'volume_name': 'volume-1d1721ea-0bc1-469b-8423-ca81a212819c', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c6225ed-616e-407a-a2c9-9ac75a6452ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c6225ed-616e-407a-a2c9-9ac75a6452ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37411af5-baeb-4376-8e86-41193e60a1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:09 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] Volume 1d1721ea-0bc1-469b-8423-ca81a212819c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d1721ea-0bc1-469b-8423-ca81a212819c', 'volume_size': 1} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-564993195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d1721ea-0bc1-469b-8423-ca81a212819c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49d8b707d5ae42138533af28a1c2e47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:09Z,use_quota=True,user_id='62135b8905134d639cec7d4c67e56f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] Creating volume 1d1721ea-0bc1-469b-8423-ca81a212819c {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:09 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1d1721ea-0bc1-469b-8423-ca81a212819c 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a38b1052-3b4f-4474-99ac-eada1b4be698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac89e73a-89cb-4500-b804-07b6b1c59abc', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed1ab50-6cf7-4b1f-b48d-6755616f6d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:09 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1d1721ea-0bc1-469b-8423-ca81a212819c 1073741824 Sep 01 02:11:09 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:09 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Volume volume-ac89e73a-89cb-4500-b804-07b6b1c59abc (ac89e73a-89cb-4500-b804-07b6b1c59abc): created successfully Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed1ab50-6cf7-4b1f-b48d-6755616f6d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Flow 'volume_create_manager' (fc94ea2d-b6de-4b33-84df-2fdbfe3a92e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:09 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-9207a7e4-c357-42c8-bdf0-9240271e84f8 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Created volume successfully. Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7582dd37-f590-4117-a664-8bfe77811f3d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "cinder-ac89e73a-89cb-4500-b804-07b6b1c59abc-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7582dd37-f590-4117-a664-8bfe77811f3d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "cinder-ac89e73a-89cb-4500-b804-07b6b1c59abc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7582dd37-f590-4117-a664-8bfe77811f3d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "cinder-quobyte-ac89e73a-89cb-4500-b804-07b6b1c59abc" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7582dd37-f590-4117-a664-8bfe77811f3d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "cinder-quobyte-ac89e73a-89cb-4500-b804-07b6b1c59abc" acquired by "delete_volume" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b60b516-fa5d-481b-89d6-7d9de237e6a9]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:09 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7582dd37-f590-4117-a664-8bfe77811f3d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ac89e73a-89cb-4500-b804-07b6b1c59abc {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1d1721ea-0bc1-469b-8423-ca81a212819c 1073741824" returned: 0 in 0.559s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1d1721ea-0bc1-469b-8423-ca81a212819c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:09 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1d1721ea-0bc1-469b-8423-ca81a212819c Sep 01 02:11:09 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:09 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ac89e73a-89cb-4500-b804-07b6b1c59abc Sep 01 02:11:09 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:10 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1d1721ea-0bc1-469b-8423-ca81a212819c" returned: 0 in 0.306s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:10 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:10 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37411af5-baeb-4376-8e86-41193e60a1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d1721ea-0bc1-469b-8423-ca81a212819c', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:10 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (442781e0-75f8-4c35-a8c8-eec2c394c34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:10 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] Volume volume-1d1721ea-0bc1-469b-8423-ca81a212819c (1d1721ea-0bc1-469b-8423-ca81a212819c): created successfully Sep 01 02:11:10 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (442781e0-75f8-4c35-a8c8-eec2c394c34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:10 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] Flow 'volume_create_manager' (7aad06cf-9b44-427e-a2eb-4525f9a29b54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:10 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-081c2538-8ffb-47e0-a6df-ad75f438b6f0 tempest-ProjectReaderTests-1371781335 None] Created volume successfully. Sep 01 02:11:10 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7582dd37-f590-4117-a664-8bfe77811f3d tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ac89e73a-89cb-4500-b804-07b6b1c59abc" returned: 0 in 0.446s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7582dd37-f590-4117-a664-8bfe77811f3d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ac89e73a-89cb-4500-b804-07b6b1c59abc {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:10 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ac89e73a-89cb-4500-b804-07b6b1c59abc Sep 01 02:11:10 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:10 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7582dd37-f590-4117-a664-8bfe77811f3d tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ac89e73a-89cb-4500-b804-07b6b1c59abc" returned: 0 in 0.267s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:10 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7582dd37-f590-4117-a664-8bfe77811f3d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "cinder-quobyte-ac89e73a-89cb-4500-b804-07b6b1c59abc" released by "delete_volume" :: held 0.765s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:10 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-7582dd37-f590-4117-a664-8bfe77811f3d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Created reservations ['cd19a55b-980e-4543-b933-91d3a8fff74d', '83a7617f-8da6-4517-ba39-c927edce75b2', '3875731b-1e1b-4364-94ed-62f4fdf3eb0f', '89b1c9f1-89fb-4111-a6c2-e4e37dbf5099'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7582dd37-f590-4117-a664-8bfe77811f3d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7582dd37-f590-4117-a664-8bfe77811f3d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:10 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7582dd37-f590-4117-a664-8bfe77811f3d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:10 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7582dd37-f590-4117-a664-8bfe77811f3d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7582dd37-f590-4117-a664-8bfe77811f3d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7582dd37-f590-4117-a664-8bfe77811f3d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:10 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:11:10 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:10 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8d2c6258-572a-4964-b0d5-120b3492d1d9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "cinder-82c14283-2114-48e5-9056-9d5cfd3847fd-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:10 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8d2c6258-572a-4964-b0d5-120b3492d1d9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "cinder-82c14283-2114-48e5-9056-9d5cfd3847fd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:10 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8d2c6258-572a-4964-b0d5-120b3492d1d9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "cinder-quobyte-82c14283-2114-48e5-9056-9d5cfd3847fd" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:10 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8d2c6258-572a-4964-b0d5-120b3492d1d9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "cinder-quobyte-82c14283-2114-48e5-9056-9d5cfd3847fd" acquired by "delete_volume" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:10 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7582dd37-f590-4117-a664-8bfe77811f3d tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.334s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:10 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-7582dd37-f590-4117-a664-8bfe77811f3d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:10 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-7582dd37-f590-4117-a664-8bfe77811f3d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Deleted volume successfully. Sep 01 02:11:10 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4ed4d9-590b-44ae-aaae-a458ee267d19]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8d2c6258-572a-4964-b0d5-120b3492d1d9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-82c14283-2114-48e5-9056-9d5cfd3847fd {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:10 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7582dd37-f590-4117-a664-8bfe77811f3d tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "cinder-ac89e73a-89cb-4500-b804-07b6b1c59abc-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:11 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-82c14283-2114-48e5-9056-9d5cfd3847fd Sep 01 02:11:11 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:11 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8d2c6258-572a-4964-b0d5-120b3492d1d9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-82c14283-2114-48e5-9056-9d5cfd3847fd" returned: 0 in 0.430s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8d2c6258-572a-4964-b0d5-120b3492d1d9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-82c14283-2114-48e5-9056-9d5cfd3847fd {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:11 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-82c14283-2114-48e5-9056-9d5cfd3847fd Sep 01 02:11:11 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6304b360-60f5-4dd7-994b-b0ccca6a4309 tempest-ProjectReaderTests-1371781335 None] Acquiring lock "cinder-1d1721ea-0bc1-469b-8423-ca81a212819c-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6304b360-60f5-4dd7-994b-b0ccca6a4309 tempest-ProjectReaderTests-1371781335 None] Lock "cinder-1d1721ea-0bc1-469b-8423-ca81a212819c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6304b360-60f5-4dd7-994b-b0ccca6a4309 tempest-ProjectReaderTests-1371781335 None] Acquiring lock "cinder-quobyte-1d1721ea-0bc1-469b-8423-ca81a212819c" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6304b360-60f5-4dd7-994b-b0ccca6a4309 tempest-ProjectReaderTests-1371781335 None] Lock "cinder-quobyte-1d1721ea-0bc1-469b-8423-ca81a212819c" acquired by "delete_volume" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:11 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[10273107-b279-4b5e-b52a-5e11d4f3bb16]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6304b360-60f5-4dd7-994b-b0ccca6a4309 tempest-ProjectReaderTests-1371781335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1d1721ea-0bc1-469b-8423-ca81a212819c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:11 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8d2c6258-572a-4964-b0d5-120b3492d1d9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-82c14283-2114-48e5-9056-9d5cfd3847fd" returned: 0 in 0.310s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:11 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1d1721ea-0bc1-469b-8423-ca81a212819c Sep 01 02:11:11 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8d2c6258-572a-4964-b0d5-120b3492d1d9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "cinder-quobyte-82c14283-2114-48e5-9056-9d5cfd3847fd" released by "delete_volume" :: held 0.801s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:11 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-8d2c6258-572a-4964-b0d5-120b3492d1d9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Created reservations ['409868b0-2ecf-4700-bf3e-d80c0549caf8', '939bc3f1-4e7e-4100-9509-d4c01c3aa9e8', '25a02f5a-61d9-4ea9-9db2-afc5305819c2', '8d619e66-26cc-4142-9aaf-39d1cfdab8b2'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8d2c6258-572a-4964-b0d5-120b3492d1d9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8d2c6258-572a-4964-b0d5-120b3492d1d9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:11 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8d2c6258-572a-4964-b0d5-120b3492d1d9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:11 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8d2c6258-572a-4964-b0d5-120b3492d1d9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8d2c6258-572a-4964-b0d5-120b3492d1d9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8d2c6258-572a-4964-b0d5-120b3492d1d9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:11 devstack sudo[102411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:11:11 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:11 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ce538af9-7230-4846-b834-67796fb9049b tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "cinder-d78ffca8-c589-4417-8695-d83c14e5266e-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6304b360-60f5-4dd7-994b-b0ccca6a4309 tempest-ProjectReaderTests-1371781335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1d1721ea-0bc1-469b-8423-ca81a212819c" returned: 0 in 0.483s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6304b360-60f5-4dd7-994b-b0ccca6a4309 tempest-ProjectReaderTests-1371781335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1d1721ea-0bc1-469b-8423-ca81a212819c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:12 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ce538af9-7230-4846-b834-67796fb9049b tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "cinder-d78ffca8-c589-4417-8695-d83c14e5266e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:12 devstack sudo[102414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1d1721ea-0bc1-469b-8423-ca81a212819c Sep 01 02:11:12 devstack sudo[102414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:12 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ce538af9-7230-4846-b834-67796fb9049b tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "cinder-quobyte-d78ffca8-c589-4417-8695-d83c14e5266e" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:12 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ce538af9-7230-4846-b834-67796fb9049b tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "cinder-quobyte-d78ffca8-c589-4417-8695-d83c14e5266e" acquired by "delete_volume" :: waited 0.023s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:12 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3962ce4-7ea7-4aa8-bf44-592053f42abe]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ce538af9-7230-4846-b834-67796fb9049b tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d78ffca8-c589-4417-8695-d83c14e5266e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:12 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8d2c6258-572a-4964-b0d5-120b3492d1d9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.323s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:12 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-8d2c6258-572a-4964-b0d5-120b3492d1d9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:12 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-8d2c6258-572a-4964-b0d5-120b3492d1d9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Deleted volume successfully. Sep 01 02:11:12 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8d2c6258-572a-4964-b0d5-120b3492d1d9 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "cinder-82c14283-2114-48e5-9056-9d5cfd3847fd-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:12 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d78ffca8-c589-4417-8695-d83c14e5266e Sep 01 02:11:12 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:12 devstack sudo[102414]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6304b360-60f5-4dd7-994b-b0ccca6a4309 tempest-ProjectReaderTests-1371781335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-1d1721ea-0bc1-469b-8423-ca81a212819c" returned: 0 in 0.323s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:12 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6304b360-60f5-4dd7-994b-b0ccca6a4309 tempest-ProjectReaderTests-1371781335 None] Lock "cinder-quobyte-1d1721ea-0bc1-469b-8423-ca81a212819c" released by "delete_volume" :: held 0.851s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:12 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-6304b360-60f5-4dd7-994b-b0ccca6a4309 tempest-ProjectReaderTests-1371781335 None] Created reservations ['ad78d1bd-e490-42cb-8eec-88fffcab3030', '634ecf17-57ac-4352-9d0b-e5484c35934d', '0f111552-7182-45be-8c97-175498a989c3', '9f59cbd1-1149-4d8c-8b82-d5203c416b3d'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6304b360-60f5-4dd7-994b-b0ccca6a4309 tempest-ProjectReaderTests-1371781335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6304b360-60f5-4dd7-994b-b0ccca6a4309 tempest-ProjectReaderTests-1371781335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:12 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-6304b360-60f5-4dd7-994b-b0ccca6a4309 tempest-ProjectReaderTests-1371781335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:12 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-6304b360-60f5-4dd7-994b-b0ccca6a4309 tempest-ProjectReaderTests-1371781335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6304b360-60f5-4dd7-994b-b0ccca6a4309 tempest-ProjectReaderTests-1371781335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6304b360-60f5-4dd7-994b-b0ccca6a4309 tempest-ProjectReaderTests-1371781335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:12 devstack sudo[102420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:11:12 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:12 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ce538af9-7230-4846-b834-67796fb9049b tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d78ffca8-c589-4417-8695-d83c14e5266e" returned: 0 in 0.568s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ce538af9-7230-4846-b834-67796fb9049b tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d78ffca8-c589-4417-8695-d83c14e5266e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:12 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d78ffca8-c589-4417-8695-d83c14e5266e Sep 01 02:11:12 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:12 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6304b360-60f5-4dd7-994b-b0ccca6a4309 tempest-ProjectReaderTests-1371781335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.292s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:12 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-6304b360-60f5-4dd7-994b-b0ccca6a4309 tempest-ProjectReaderTests-1371781335 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:12 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-6304b360-60f5-4dd7-994b-b0ccca6a4309 tempest-ProjectReaderTests-1371781335 None] Deleted volume successfully. Sep 01 02:11:12 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6304b360-60f5-4dd7-994b-b0ccca6a4309 tempest-ProjectReaderTests-1371781335 None] Lock "cinder-1d1721ea-0bc1-469b-8423-ca81a212819c-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:13 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ce538af9-7230-4846-b834-67796fb9049b tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d78ffca8-c589-4417-8695-d83c14e5266e" returned: 0 in 0.340s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ce538af9-7230-4846-b834-67796fb9049b tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "cinder-quobyte-d78ffca8-c589-4417-8695-d83c14e5266e" released by "delete_volume" :: held 0.981s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-ce538af9-7230-4846-b834-67796fb9049b tempest-CreateVolumesFromSnapshotTest-1039925740 None] Created reservations ['1cb11cab-b3f6-4434-a7f2-f4d125fdb379', '3b6a1623-9eae-456f-b1e1-ab1246412a25', 'd77ee0ad-7ce3-456c-9408-1973a6daac48', '484717c4-b04f-4e73-ae25-613cdecaf6ff'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] Flow 'volume_create_manager' (f5e8e2b8-39a9-450a-999a-cf5c44c135a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a3f7e3-8023-4d20-a8f1-b6071a29e8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a3f7e3-8023-4d20-a8f1-b6071a29e8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-124547260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb807fc8-9754-47fd-9011-91ee6f4617e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49d8b707d5ae42138533af28a1c2e47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:13Z,use_quota=True,user_id='62135b8905134d639cec7d4c67e56f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e7f6aa9-2da0-4d25-818c-4e9c674486ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e7f6aa9-2da0-4d25-818c-4e9c674486ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5f7a59-321a-4b97-96b3-4c4846d25347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5f7a59-321a-4b97-96b3-4c4846d25347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb807fc8-9754-47fd-9011-91ee6f4617e4', 'volume_name': 'volume-eb807fc8-9754-47fd-9011-91ee6f4617e4', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceadfcf4-3db7-42d9-90e1-fb7e69b15b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceadfcf4-3db7-42d9-90e1-fb7e69b15b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a284ee90-fbf2-4035-8d89-997fbd10d0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:13 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] Volume eb807fc8-9754-47fd-9011-91ee6f4617e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb807fc8-9754-47fd-9011-91ee6f4617e4', 'volume_size': 1} Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-124547260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb807fc8-9754-47fd-9011-91ee6f4617e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49d8b707d5ae42138533af28a1c2e47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:13Z,use_quota=True,user_id='62135b8905134d639cec7d4c67e56f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] Creating volume eb807fc8-9754-47fd-9011-91ee6f4617e4 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:13 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb807fc8-9754-47fd-9011-91ee6f4617e4 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:13 devstack sudo[102429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb807fc8-9754-47fd-9011-91ee6f4617e4 1073741824 Sep 01 02:11:13 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ce538af9-7230-4846-b834-67796fb9049b tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ce538af9-7230-4846-b834-67796fb9049b tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-ce538af9-7230-4846-b834-67796fb9049b tempest-CreateVolumesFromSnapshotTest-1039925740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-ce538af9-7230-4846-b834-67796fb9049b tempest-CreateVolumesFromSnapshotTest-1039925740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ce538af9-7230-4846-b834-67796fb9049b tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ce538af9-7230-4846-b834-67796fb9049b tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:13 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:11:13 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:13 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ce538af9-7230-4846-b834-67796fb9049b tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.304s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-ce538af9-7230-4846-b834-67796fb9049b tempest-CreateVolumesFromSnapshotTest-1039925740 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:13 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-ce538af9-7230-4846-b834-67796fb9049b tempest-CreateVolumesFromSnapshotTest-1039925740 None] Deleted volume successfully. Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ce538af9-7230-4846-b834-67796fb9049b tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "cinder-d78ffca8-c589-4417-8695-d83c14e5266e-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:13 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb807fc8-9754-47fd-9011-91ee6f4617e4 1073741824" returned: 0 in 0.545s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb807fc8-9754-47fd-9011-91ee6f4617e4 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:13 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb807fc8-9754-47fd-9011-91ee6f4617e4 Sep 01 02:11:13 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:14 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb807fc8-9754-47fd-9011-91ee6f4617e4" returned: 0 in 0.269s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a284ee90-fbf2-4035-8d89-997fbd10d0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb807fc8-9754-47fd-9011-91ee6f4617e4', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be8f655-4774-41bb-8ea3-dd5988267ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:14 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] Volume volume-eb807fc8-9754-47fd-9011-91ee6f4617e4 (eb807fc8-9754-47fd-9011-91ee6f4617e4): created successfully Sep 01 02:11:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be8f655-4774-41bb-8ea3-dd5988267ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] Flow 'volume_create_manager' (f5e8e2b8-39a9-450a-999a-cf5c44c135a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:14 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-80dcbb1a-306d-46a8-bf4c-79da36b7d42c tempest-ProjectReaderTests-1371781335 None] Created volume successfully. Sep 01 02:11:14 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-991fbb09-531f-48f3-8b74-92be9aa73afd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "cinder-8120d214-16e2-40e8-b103-79333c2c12e6-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:14 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-991fbb09-531f-48f3-8b74-92be9aa73afd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "cinder-8120d214-16e2-40e8-b103-79333c2c12e6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:14 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-991fbb09-531f-48f3-8b74-92be9aa73afd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "cinder-quobyte-8120d214-16e2-40e8-b103-79333c2c12e6" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:14 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-991fbb09-531f-48f3-8b74-92be9aa73afd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "cinder-quobyte-8120d214-16e2-40e8-b103-79333c2c12e6" acquired by "delete_volume" :: waited 0.013s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:14 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a41dc86-29f4-4a7a-bf4a-a7ac4a0e4a6f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-991fbb09-531f-48f3-8b74-92be9aa73afd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8120d214-16e2-40e8-b103-79333c2c12e6 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:14 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8120d214-16e2-40e8-b103-79333c2c12e6 Sep 01 02:11:14 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:14 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-991fbb09-531f-48f3-8b74-92be9aa73afd tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8120d214-16e2-40e8-b103-79333c2c12e6" returned: 0 in 0.368s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-991fbb09-531f-48f3-8b74-92be9aa73afd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8120d214-16e2-40e8-b103-79333c2c12e6 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:14 devstack sudo[102446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8120d214-16e2-40e8-b103-79333c2c12e6 Sep 01 02:11:14 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:15 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-991fbb09-531f-48f3-8b74-92be9aa73afd tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8120d214-16e2-40e8-b103-79333c2c12e6" returned: 0 in 0.283s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:15 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-991fbb09-531f-48f3-8b74-92be9aa73afd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "cinder-quobyte-8120d214-16e2-40e8-b103-79333c2c12e6" released by "delete_volume" :: held 0.691s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:15 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-991fbb09-531f-48f3-8b74-92be9aa73afd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Created reservations ['60df33bb-3dc4-477d-abcc-cd8b397263db', 'a58c2bda-17a0-46cc-8653-1be99e927d1a', '42cde4bd-8329-4da5-a682-e8e713dbe573', 'e76432be-ccda-419a-9866-1bda3f243b4c'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-991fbb09-531f-48f3-8b74-92be9aa73afd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-991fbb09-531f-48f3-8b74-92be9aa73afd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:15 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-991fbb09-531f-48f3-8b74-92be9aa73afd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:15 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-991fbb09-531f-48f3-8b74-92be9aa73afd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-991fbb09-531f-48f3-8b74-92be9aa73afd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-991fbb09-531f-48f3-8b74-92be9aa73afd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:15 devstack sudo[102449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:11:15 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:15 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8ec75aa4-3362-42e9-94b7-6d5019a49e6a tempest-ProjectReaderTests-1371781335 None] Acquiring lock "cinder-eb807fc8-9754-47fd-9011-91ee6f4617e4-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:15 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8ec75aa4-3362-42e9-94b7-6d5019a49e6a tempest-ProjectReaderTests-1371781335 None] Lock "cinder-eb807fc8-9754-47fd-9011-91ee6f4617e4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:15 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8ec75aa4-3362-42e9-94b7-6d5019a49e6a tempest-ProjectReaderTests-1371781335 None] Acquiring lock "cinder-quobyte-eb807fc8-9754-47fd-9011-91ee6f4617e4" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:15 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8ec75aa4-3362-42e9-94b7-6d5019a49e6a tempest-ProjectReaderTests-1371781335 None] Lock "cinder-quobyte-eb807fc8-9754-47fd-9011-91ee6f4617e4" acquired by "delete_volume" :: waited 0.024s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:15 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-09fb7181-00a8-481b-8675-a692096faed4 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "cinder-6a44b51e-1bff-430f-afde-4df4d74b860b-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:15 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[705517b2-d3dd-4aaf-bb8c-f070c5d4ce1f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8ec75aa4-3362-42e9-94b7-6d5019a49e6a tempest-ProjectReaderTests-1371781335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb807fc8-9754-47fd-9011-91ee6f4617e4 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:15 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-09fb7181-00a8-481b-8675-a692096faed4 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "cinder-6a44b51e-1bff-430f-afde-4df4d74b860b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:15 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-09fb7181-00a8-481b-8675-a692096faed4 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "cinder-quobyte-6a44b51e-1bff-430f-afde-4df4d74b860b" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:15 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-09fb7181-00a8-481b-8675-a692096faed4 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "cinder-quobyte-6a44b51e-1bff-430f-afde-4df4d74b860b" acquired by "delete_volume" :: waited 0.015s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:15 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdedae37-9246-4707-a446-9ef22828dd5c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-09fb7181-00a8-481b-8675-a692096faed4 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6a44b51e-1bff-430f-afde-4df4d74b860b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:15 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb807fc8-9754-47fd-9011-91ee6f4617e4 Sep 01 02:11:15 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:15 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-991fbb09-531f-48f3-8b74-92be9aa73afd tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.458s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:15 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-991fbb09-531f-48f3-8b74-92be9aa73afd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:15 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-991fbb09-531f-48f3-8b74-92be9aa73afd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Deleted volume successfully. Sep 01 02:11:15 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=171,cinder:DELETE=13,cinder:UPDATE=208,cinder:INSERT=51 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:11:15 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6a44b51e-1bff-430f-afde-4df4d74b860b Sep 01 02:11:15 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:15 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-991fbb09-531f-48f3-8b74-92be9aa73afd tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "cinder-8120d214-16e2-40e8-b103-79333c2c12e6-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:16 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8ec75aa4-3362-42e9-94b7-6d5019a49e6a tempest-ProjectReaderTests-1371781335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb807fc8-9754-47fd-9011-91ee6f4617e4" returned: 0 in 0.508s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8ec75aa4-3362-42e9-94b7-6d5019a49e6a tempest-ProjectReaderTests-1371781335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb807fc8-9754-47fd-9011-91ee6f4617e4 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:16 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb807fc8-9754-47fd-9011-91ee6f4617e4 Sep 01 02:11:16 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:16 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-09fb7181-00a8-481b-8675-a692096faed4 tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6a44b51e-1bff-430f-afde-4df4d74b860b" returned: 0 in 0.443s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-09fb7181-00a8-481b-8675-a692096faed4 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6a44b51e-1bff-430f-afde-4df4d74b860b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:16 devstack sudo[102465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6a44b51e-1bff-430f-afde-4df4d74b860b Sep 01 02:11:16 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:16 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8ec75aa4-3362-42e9-94b7-6d5019a49e6a tempest-ProjectReaderTests-1371781335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-eb807fc8-9754-47fd-9011-91ee6f4617e4" returned: 0 in 0.279s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8ec75aa4-3362-42e9-94b7-6d5019a49e6a tempest-ProjectReaderTests-1371781335 None] Lock "cinder-quobyte-eb807fc8-9754-47fd-9011-91ee6f4617e4" released by "delete_volume" :: held 0.849s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:16 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-09fb7181-00a8-481b-8675-a692096faed4 tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-6a44b51e-1bff-430f-afde-4df4d74b860b" returned: 0 in 0.255s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-09fb7181-00a8-481b-8675-a692096faed4 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "cinder-quobyte-6a44b51e-1bff-430f-afde-4df4d74b860b" released by "delete_volume" :: held 0.752s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-8ec75aa4-3362-42e9-94b7-6d5019a49e6a tempest-ProjectReaderTests-1371781335 None] Created reservations ['39967c66-3f80-4810-a3b0-abd88e135b8b', '052bcaa6-baa1-4ffb-979d-dbe90fe2a35c', 'f49a6576-3dd2-4957-a23b-04e7fb4811be', 'a1c40d3f-2051-43ff-ac0f-c27efb5f5909'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-09fb7181-00a8-481b-8675-a692096faed4 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Created reservations ['d9f52a5a-9473-4c2f-b23b-5b285e614469', '1111b928-164b-4c1d-964e-2a686d250545', 'b7b1fa54-89ef-41ba-bf74-07afa8044995', '1c9d1d6b-9b25-47df-b01d-e4e357099d2b'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8ec75aa4-3362-42e9-94b7-6d5019a49e6a tempest-ProjectReaderTests-1371781335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8ec75aa4-3362-42e9-94b7-6d5019a49e6a tempest-ProjectReaderTests-1371781335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8ec75aa4-3362-42e9-94b7-6d5019a49e6a tempest-ProjectReaderTests-1371781335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8ec75aa4-3362-42e9-94b7-6d5019a49e6a tempest-ProjectReaderTests-1371781335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8ec75aa4-3362-42e9-94b7-6d5019a49e6a tempest-ProjectReaderTests-1371781335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8ec75aa4-3362-42e9-94b7-6d5019a49e6a tempest-ProjectReaderTests-1371781335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:16 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:11:16 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-09fb7181-00a8-481b-8675-a692096faed4 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-09fb7181-00a8-481b-8675-a692096faed4 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-09fb7181-00a8-481b-8675-a692096faed4 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-09fb7181-00a8-481b-8675-a692096faed4 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-09fb7181-00a8-481b-8675-a692096faed4 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-09fb7181-00a8-481b-8675-a692096faed4 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:16 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:11:16 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-76c4b804-35aa-44a3-bdf6-bce05f3c3692 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "cinder-df720a1d-3537-46b9-b3c5-5116f66ac503-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-76c4b804-35aa-44a3-bdf6-bce05f3c3692 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "cinder-df720a1d-3537-46b9-b3c5-5116f66ac503-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-76c4b804-35aa-44a3-bdf6-bce05f3c3692 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "cinder-quobyte-8a807691-ad91-4f75-b956-2d60a489e0c5" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-76c4b804-35aa-44a3-bdf6-bce05f3c3692 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "cinder-quobyte-8a807691-ad91-4f75-b956-2d60a489e0c5" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-76c4b804-35aa-44a3-bdf6-bce05f3c3692 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "cinder-quobyte-df720a1d-3537-46b9-b3c5-5116f66ac503" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:16 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8ec75aa4-3362-42e9-94b7-6d5019a49e6a tempest-ProjectReaderTests-1371781335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.327s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-8ec75aa4-3362-42e9-94b7-6d5019a49e6a tempest-ProjectReaderTests-1371781335 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:16 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-8ec75aa4-3362-42e9-94b7-6d5019a49e6a tempest-ProjectReaderTests-1371781335 None] Deleted volume successfully. Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-76c4b804-35aa-44a3-bdf6-bce05f3c3692 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "cinder-quobyte-df720a1d-3537-46b9-b3c5-5116f66ac503" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-76c4b804-35aa-44a3-bdf6-bce05f3c3692 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Deleting offline snapshot df720a1d-3537-46b9-b3c5-5116f66ac503 of volume 8a807691-ad91-4f75-b956-2d60a489e0c5 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-76c4b804-35aa-44a3-bdf6-bce05f3c3692 tempest-CreateVolumesFromSnapshotTest-1039925740 None] snapshot_file for this snap is: volume-8a807691-ad91-4f75-b956-2d60a489e0c5.df720a1d-3537-46b9-b3c5-5116f66ac503 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d101a1-fb01-4d24-b592-a139c03bcde9]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:17 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-76c4b804-35aa-44a3-bdf6-bce05f3c3692 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5.df720a1d-3537-46b9-b3c5-5116f66ac503 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:17 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:11:17 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-09fb7181-00a8-481b-8675-a692096faed4 tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.377s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-09fb7181-00a8-481b-8675-a692096faed4 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8ec75aa4-3362-42e9-94b7-6d5019a49e6a tempest-ProjectReaderTests-1371781335 None] Lock "cinder-eb807fc8-9754-47fd-9011-91ee6f4617e4-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:17 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-09fb7181-00a8-481b-8675-a692096faed4 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Deleted volume successfully. Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-09fb7181-00a8-481b-8675-a692096faed4 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "cinder-6a44b51e-1bff-430f-afde-4df4d74b860b-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:17 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5.df720a1d-3537-46b9-b3c5-5116f66ac503 Sep 01 02:11:17 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:17 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.309s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager._thread_info {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread count: 29 {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread info: [<_MainThread(MainThread, started 128688016527488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] Flow 'volume_create_manager' (ba339805-0461-4bd7-b207-acdb48b8f02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbd88c2a-54bd-471b-8f93-775976f68856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbd88c2a-54bd-471b-8f93-775976f68856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-202037962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1858269-7634-45e5-bbe1-369dea4b6da3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49d8b707d5ae42138533af28a1c2e47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:17Z,use_quota=True,user_id='62135b8905134d639cec7d4c67e56f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2567348a-42a3-45b2-bb8b-5059a2aeb5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2567348a-42a3-45b2-bb8b-5059a2aeb5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1635739-6067-46f8-b373-433ff1985942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1635739-6067-46f8-b373-433ff1985942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1858269-7634-45e5-bbe1-369dea4b6da3', 'volume_name': 'volume-c1858269-7634-45e5-bbe1-369dea4b6da3', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d7842b-2fa6-4750-a493-5cdb83d332f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d7842b-2fa6-4750-a493-5cdb83d332f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (649ca082-8142-4fba-8fbf-df56e60dd18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:17 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] Volume c1858269-7634-45e5-bbe1-369dea4b6da3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1858269-7634-45e5-bbe1-369dea4b6da3', 'volume_size': 1} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-202037962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1858269-7634-45e5-bbe1-369dea4b6da3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49d8b707d5ae42138533af28a1c2e47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:17Z,use_quota=True,user_id='62135b8905134d639cec7d4c67e56f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] Creating volume c1858269-7634-45e5-bbe1-369dea4b6da3 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:17 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c1858269-7634-45e5-bbe1-369dea4b6da3 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:17 devstack sudo[102482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c1858269-7634-45e5-bbe1-369dea4b6da3 1073741824 Sep 01 02:11:17 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:17 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-76c4b804-35aa-44a3-bdf6-bce05f3c3692 tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5.df720a1d-3537-46b9-b3c5-5116f66ac503" returned: 0 in 0.510s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-76c4b804-35aa-44a3-bdf6-bce05f3c3692 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a807691-ad91-4f75-b956-2d60a489e0c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da9936c-ec4c-4333-bbfe-a4c556420e8a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-76c4b804-35aa-44a3-bdf6-bce05f3c3692 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:17 devstack sudo[102485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5 Sep 01 02:11:17 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:18 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-76c4b804-35aa-44a3-bdf6-bce05f3c3692 tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5" returned: 0 in 0.504s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-76c4b804-35aa-44a3-bdf6-bce05f3c3692 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5.df720a1d-3537-46b9-b3c5-5116f66ac503 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:18 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:18 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5.df720a1d-3537-46b9-b3c5-5116f66ac503 Sep 01 02:11:18 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c1858269-7634-45e5-bbe1-369dea4b6da3 1073741824" returned: 0 in 0.654s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c1858269-7634-45e5-bbe1-369dea4b6da3 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:18 devstack sudo[102496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c1858269-7634-45e5-bbe1-369dea4b6da3 Sep 01 02:11:18 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:18 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-76c4b804-35aa-44a3-bdf6-bce05f3c3692 tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5.df720a1d-3537-46b9-b3c5-5116f66ac503" returned: 0 in 0.401s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-76c4b804-35aa-44a3-bdf6-bce05f3c3692 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5.df720a1d-3537-46b9-b3c5-5116f66ac503 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:18 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c1858269-7634-45e5-bbe1-369dea4b6da3" returned: 0 in 0.339s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:18 devstack sudo[102503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5.df720a1d-3537-46b9-b3c5-5116f66ac503 Sep 01 02:11:18 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (649ca082-8142-4fba-8fbf-df56e60dd18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1858269-7634-45e5-bbe1-369dea4b6da3', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7934b86-de4a-4233-92f1-524c3b73efef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:18 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] Volume volume-c1858269-7634-45e5-bbe1-369dea4b6da3 (c1858269-7634-45e5-bbe1-369dea4b6da3): created successfully Sep 01 02:11:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7934b86-de4a-4233-92f1-524c3b73efef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] Flow 'volume_create_manager' (ba339805-0461-4bd7-b207-acdb48b8f02f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:18 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-a94f5fbf-3077-4585-8029-05dcbfbf39c4 tempest-ProjectReaderTests-1371781335 None] Created volume successfully. Sep 01 02:11:18 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-76c4b804-35aa-44a3-bdf6-bce05f3c3692 tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5.df720a1d-3537-46b9-b3c5-5116f66ac503" returned: 0 in 0.274s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:18 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-76c4b804-35aa-44a3-bdf6-bce05f3c3692 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "cinder-quobyte-df720a1d-3537-46b9-b3c5-5116f66ac503" released by "_delete_snapshot" :: held 1.834s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:18 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-76c4b804-35aa-44a3-bdf6-bce05f3c3692 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "cinder-quobyte-8a807691-ad91-4f75-b956-2d60a489e0c5" released by "delete_snapshot" :: held 1.888s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:18 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-76c4b804-35aa-44a3-bdf6-bce05f3c3692 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Created reservations ['5c530568-96f4-4b11-8a66-4cf317cfe9c4', '686f9f78-d589-49d4-93d8-06a0dae51ade', '676a2033-9330-4c38-914e-02972ec05509', '2c00ef73-00d0-457c-962a-79262c3e7141'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:18 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-76c4b804-35aa-44a3-bdf6-bce05f3c3692 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Delete snapshot completed successfully. Sep 01 02:11:18 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-76c4b804-35aa-44a3-bdf6-bce05f3c3692 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "cinder-df720a1d-3537-46b9-b3c5-5116f66ac503-delete_snapshot" released by "delete_snapshot" :: held 2.052s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2b4caff7-f6e7-4e85-a3ac-1d21f6cd52f2 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "cinder-8a807691-ad91-4f75-b956-2d60a489e0c5-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2b4caff7-f6e7-4e85-a3ac-1d21f6cd52f2 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "cinder-8a807691-ad91-4f75-b956-2d60a489e0c5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2b4caff7-f6e7-4e85-a3ac-1d21f6cd52f2 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "cinder-quobyte-8a807691-ad91-4f75-b956-2d60a489e0c5" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2b4caff7-f6e7-4e85-a3ac-1d21f6cd52f2 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "cinder-quobyte-8a807691-ad91-4f75-b956-2d60a489e0c5" acquired by "delete_volume" :: waited 0.015s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:19 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[246bad42-a4a5-4b2a-a043-abe577cd7f07]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2b4caff7-f6e7-4e85-a3ac-1d21f6cd52f2 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:19 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5 Sep 01 02:11:19 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bfced81e-8bdd-44ac-9d68-92c87a9cd3da tempest-ProjectReaderTests-1371781335 None] Acquiring lock "cinder-c1858269-7634-45e5-bbe1-369dea4b6da3-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:19 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2b4caff7-f6e7-4e85-a3ac-1d21f6cd52f2 tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5" returned: 0 in 0.407s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2b4caff7-f6e7-4e85-a3ac-1d21f6cd52f2 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:19 devstack sudo[102511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5 Sep 01 02:11:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bfced81e-8bdd-44ac-9d68-92c87a9cd3da tempest-ProjectReaderTests-1371781335 None] Lock "cinder-c1858269-7634-45e5-bbe1-369dea4b6da3-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:19 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bfced81e-8bdd-44ac-9d68-92c87a9cd3da tempest-ProjectReaderTests-1371781335 None] Acquiring lock "cinder-quobyte-c1858269-7634-45e5-bbe1-369dea4b6da3" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bfced81e-8bdd-44ac-9d68-92c87a9cd3da tempest-ProjectReaderTests-1371781335 None] Lock "cinder-quobyte-c1858269-7634-45e5-bbe1-369dea4b6da3" acquired by "delete_volume" :: waited 0.018s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:19 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c761c6-df79-43d8-9519-9b9020f6ccd4]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bfced81e-8bdd-44ac-9d68-92c87a9cd3da tempest-ProjectReaderTests-1371781335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c1858269-7634-45e5-bbe1-369dea4b6da3 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:19 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c1858269-7634-45e5-bbe1-369dea4b6da3 Sep 01 02:11:19 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:19 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2b4caff7-f6e7-4e85-a3ac-1d21f6cd52f2 tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a807691-ad91-4f75-b956-2d60a489e0c5" returned: 0 in 0.278s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2b4caff7-f6e7-4e85-a3ac-1d21f6cd52f2 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "cinder-quobyte-8a807691-ad91-4f75-b956-2d60a489e0c5" released by "delete_volume" :: held 0.764s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:19 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-2b4caff7-f6e7-4e85-a3ac-1d21f6cd52f2 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Created reservations ['1afb36ff-3cbe-4722-bc9a-ca2b382c21a6', '4b38648d-e5d9-48a2-ae56-50dc27464c2b', 'ae43a87e-4ca6-43dd-a88a-982e6c9c61bb', 'b757af6e-89fb-49f3-aaa5-8bec11977a35'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2b4caff7-f6e7-4e85-a3ac-1d21f6cd52f2 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2b4caff7-f6e7-4e85-a3ac-1d21f6cd52f2 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:20 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2b4caff7-f6e7-4e85-a3ac-1d21f6cd52f2 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:20 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2b4caff7-f6e7-4e85-a3ac-1d21f6cd52f2 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2b4caff7-f6e7-4e85-a3ac-1d21f6cd52f2 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2b4caff7-f6e7-4e85-a3ac-1d21f6cd52f2 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:20 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:11:20 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:20 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bfced81e-8bdd-44ac-9d68-92c87a9cd3da tempest-ProjectReaderTests-1371781335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c1858269-7634-45e5-bbe1-369dea4b6da3" returned: 0 in 0.421s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bfced81e-8bdd-44ac-9d68-92c87a9cd3da tempest-ProjectReaderTests-1371781335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c1858269-7634-45e5-bbe1-369dea4b6da3 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:20 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c1858269-7634-45e5-bbe1-369dea4b6da3 Sep 01 02:11:20 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:20 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2b4caff7-f6e7-4e85-a3ac-1d21f6cd52f2 tempest-CreateVolumesFromSnapshotTest-1039925740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.337s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:20 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-2b4caff7-f6e7-4e85-a3ac-1d21f6cd52f2 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:20 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-2b4caff7-f6e7-4e85-a3ac-1d21f6cd52f2 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Deleted volume successfully. Sep 01 02:11:20 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2b4caff7-f6e7-4e85-a3ac-1d21f6cd52f2 tempest-CreateVolumesFromSnapshotTest-1039925740 None] Lock "cinder-8a807691-ad91-4f75-b956-2d60a489e0c5-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:20 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bfced81e-8bdd-44ac-9d68-92c87a9cd3da tempest-ProjectReaderTests-1371781335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c1858269-7634-45e5-bbe1-369dea4b6da3" returned: 0 in 0.486s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:20 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bfced81e-8bdd-44ac-9d68-92c87a9cd3da tempest-ProjectReaderTests-1371781335 None] Lock "cinder-quobyte-c1858269-7634-45e5-bbe1-369dea4b6da3" released by "delete_volume" :: held 0.975s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:20 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-bfced81e-8bdd-44ac-9d68-92c87a9cd3da tempest-ProjectReaderTests-1371781335 None] Created reservations ['3a50b08c-1102-4431-b8a3-2892bdf3031a', 'a339cf11-17f4-4e4b-b694-faca4b34c5c2', 'eadc0783-39ad-447f-873b-5a7f0318fea0', '731d8b20-1223-4a0b-91ce-477195a13f1a'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-bfced81e-8bdd-44ac-9d68-92c87a9cd3da tempest-ProjectReaderTests-1371781335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-bfced81e-8bdd-44ac-9d68-92c87a9cd3da tempest-ProjectReaderTests-1371781335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:20 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-bfced81e-8bdd-44ac-9d68-92c87a9cd3da tempest-ProjectReaderTests-1371781335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:20 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-bfced81e-8bdd-44ac-9d68-92c87a9cd3da tempest-ProjectReaderTests-1371781335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-bfced81e-8bdd-44ac-9d68-92c87a9cd3da tempest-ProjectReaderTests-1371781335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bfced81e-8bdd-44ac-9d68-92c87a9cd3da tempest-ProjectReaderTests-1371781335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:20 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:11:20 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:21 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bfced81e-8bdd-44ac-9d68-92c87a9cd3da tempest-ProjectReaderTests-1371781335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.298s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:21 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-bfced81e-8bdd-44ac-9d68-92c87a9cd3da tempest-ProjectReaderTests-1371781335 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:21 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-bfced81e-8bdd-44ac-9d68-92c87a9cd3da tempest-ProjectReaderTests-1371781335 None] Deleted volume successfully. Sep 01 02:11:21 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bfced81e-8bdd-44ac-9d68-92c87a9cd3da tempest-ProjectReaderTests-1371781335 None] Lock "cinder-c1858269-7634-45e5-bbe1-369dea4b6da3-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:22 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:11:22 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] Flow 'volume_create_manager' (5b9591b6-bf10-4609-8d80-c932b80223dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:22 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca9413e-b879-4f17-959a-0c0dddda2414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:22 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca9413e-b879-4f17-959a-0c0dddda2414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-874862843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e75e9083-15a0-45ae-9af9-2a808c177aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49d8b707d5ae42138533af28a1c2e47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:22Z,use_quota=True,user_id='62135b8905134d639cec7d4c67e56f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:22 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0937641f-63da-4f17-aa7d-d79a1d983774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:22 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0937641f-63da-4f17-aa7d-d79a1d983774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:22 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dd02ff2-3da2-4f3d-9841-632781947525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:22 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dd02ff2-3da2-4f3d-9841-632781947525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e75e9083-15a0-45ae-9af9-2a808c177aaf', 'volume_name': 'volume-e75e9083-15a0-45ae-9af9-2a808c177aaf', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:22 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e15f52b6-83a1-41ff-9107-74df529425e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:22 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e15f52b6-83a1-41ff-9107-74df529425e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:22 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4293566c-63c7-4502-a1ac-75554aa50301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:22 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] Volume e75e9083-15a0-45ae-9af9-2a808c177aaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e75e9083-15a0-45ae-9af9-2a808c177aaf', 'volume_size': 1} Sep 01 02:11:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:22 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-874862843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e75e9083-15a0-45ae-9af9-2a808c177aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49d8b707d5ae42138533af28a1c2e47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:22Z,use_quota=True,user_id='62135b8905134d639cec7d4c67e56f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:22 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] Creating volume e75e9083-15a0-45ae-9af9-2a808c177aaf {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:22 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:22 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:22 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:22 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:11:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e75e9083-15a0-45ae-9af9-2a808c177aaf 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:22 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e75e9083-15a0-45ae-9af9-2a808c177aaf 1073741824 Sep 01 02:11:22 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:23 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e75e9083-15a0-45ae-9af9-2a808c177aaf 1073741824" returned: 0 in 0.576s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e75e9083-15a0-45ae-9af9-2a808c177aaf {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:23 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e75e9083-15a0-45ae-9af9-2a808c177aaf Sep 01 02:11:23 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:23 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e75e9083-15a0-45ae-9af9-2a808c177aaf" returned: 0 in 0.382s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4293566c-63c7-4502-a1ac-75554aa50301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e75e9083-15a0-45ae-9af9-2a808c177aaf', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f42648f2-9fab-417b-98d9-4a252c58125a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:23 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] Volume volume-e75e9083-15a0-45ae-9af9-2a808c177aaf (e75e9083-15a0-45ae-9af9-2a808c177aaf): created successfully Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f42648f2-9fab-417b-98d9-4a252c58125a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] Flow 'volume_create_manager' (5b9591b6-bf10-4609-8d80-c932b80223dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:23 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-350b5a1e-0189-4307-9683-0c79db8e321f tempest-ProjectReaderTests-1371781335 None] Created volume successfully. Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] Flow 'volume_create_manager' (4dde0e55-b663-4134-b64b-372dfc4711eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9443b10d-74ef-46c4-9d1d-8809883100cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9443b10d-74ef-46c4-9d1d-8809883100cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2046163969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08f52d73-502e-463c-99ad-8f686073be2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78981e63bbe5435ab6563beefdadfacd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:24Z,use_quota=True,user_id='34fdd7860e18459888c84ce6d2ca5627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (923ecaa1-b325-4569-ad36-93ecc432987c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (923ecaa1-b325-4569-ad36-93ecc432987c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3528c666-9ad1-4b8e-9843-db3fb1c51c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3528c666-9ad1-4b8e-9843-db3fb1c51c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08f52d73-502e-463c-99ad-8f686073be2c', 'volume_name': 'volume-08f52d73-502e-463c-99ad-8f686073be2c', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55ac97f2-d3a0-4d2f-b36e-7a1c9707e1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55ac97f2-d3a0-4d2f-b36e-7a1c9707e1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a13f59d-3f46-45dd-98bc-6e3fc9f3e2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:23 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] Volume 08f52d73-502e-463c-99ad-8f686073be2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08f52d73-502e-463c-99ad-8f686073be2c', 'volume_size': 1} Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2046163969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08f52d73-502e-463c-99ad-8f686073be2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78981e63bbe5435ab6563beefdadfacd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:24Z,use_quota=True,user_id='34fdd7860e18459888c84ce6d2ca5627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] Creating volume 08f52d73-502e-463c-99ad-8f686073be2c {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:23 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:11:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:23 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c 1073741824 Sep 01 02:11:23 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:24 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c 1073741824" returned: 0 in 0.449s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:24 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c Sep 01 02:11:24 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] Flow 'volume_create_manager' (0acb7e58-bd89-4cb9-bfe8-f2f5c0e802c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af9de20-1012-441a-a508-64809be8fedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c0204a02-30ce-4f71-a981-cdaa16a8fda6 tempest-ProjectReaderTests-1371781335 None] Acquiring lock "cinder-e75e9083-15a0-45ae-9af9-2a808c177aaf-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af9de20-1012-441a-a508-64809be8fedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2026829479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e383027f6126434fbf53e684669500b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:25Z,use_quota=True,user_id='10ed30b4511c4837b59d56770ad9042d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (313d1cfc-3336-4fe4-ad5c-6f0595d41fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (313d1cfc-3336-4fe4-ad5c-6f0595d41fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba71a4d1-47fe-490b-918c-a4eeb5c16813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba71a4d1-47fe-490b-918c-a4eeb5c16813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b', 'volume_name': 'volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b27abd7-8353-4979-855f-ecb63d9c7ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b27abd7-8353-4979-855f-ecb63d9c7ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b2d2a4-d494-4693-a751-cb6c8fa0160b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:24 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] Volume 5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b', 'volume_size': 1} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c0204a02-30ce-4f71-a981-cdaa16a8fda6 tempest-ProjectReaderTests-1371781335 None] Lock "cinder-e75e9083-15a0-45ae-9af9-2a808c177aaf-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:24 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c" returned: 0 in 0.348s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.017s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2026829479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e383027f6126434fbf53e684669500b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:25Z,use_quota=True,user_id='10ed30b4511c4837b59d56770ad9042d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] Creating volume 5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:24 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:24 devstack sudo[102549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b 1073741824 Sep 01 02:11:24 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a13f59d-3f46-45dd-98bc-6e3fc9f3e2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08f52d73-502e-463c-99ad-8f686073be2c', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d3c43b-1a48-4991-9675-e80f7a0417df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c0204a02-30ce-4f71-a981-cdaa16a8fda6 tempest-ProjectReaderTests-1371781335 None] Acquiring lock "cinder-quobyte-e75e9083-15a0-45ae-9af9-2a808c177aaf" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:24 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] Volume volume-08f52d73-502e-463c-99ad-8f686073be2c (08f52d73-502e-463c-99ad-8f686073be2c): created successfully Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d3c43b-1a48-4991-9675-e80f7a0417df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] Flow 'volume_create_manager' (4dde0e55-b663-4134-b64b-372dfc4711eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c0204a02-30ce-4f71-a981-cdaa16a8fda6 tempest-ProjectReaderTests-1371781335 None] Lock "cinder-quobyte-e75e9083-15a0-45ae-9af9-2a808c177aaf" acquired by "delete_volume" :: waited 0.034s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b77b38-7fb1-42d0-88b6-d41e85f8ce83]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c0204a02-30ce-4f71-a981-cdaa16a8fda6 tempest-ProjectReaderTests-1371781335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e75e9083-15a0-45ae-9af9-2a808c177aaf {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:24 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-ca9a58cf-171b-4c56-b886-8c8e7896f773 tempest-VolumeDependencyTests-1101719527 None] Created volume successfully. Sep 01 02:11:25 devstack sudo[102551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e75e9083-15a0-45ae-9af9-2a808c177aaf Sep 01 02:11:25 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:25 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b 1073741824" returned: 0 in 0.447s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:25 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c0204a02-30ce-4f71-a981-cdaa16a8fda6 tempest-ProjectReaderTests-1371781335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e75e9083-15a0-45ae-9af9-2a808c177aaf" returned: 0 in 0.390s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c0204a02-30ce-4f71-a981-cdaa16a8fda6 tempest-ProjectReaderTests-1371781335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e75e9083-15a0-45ae-9af9-2a808c177aaf {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:25 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b Sep 01 02:11:25 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:25 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e75e9083-15a0-45ae-9af9-2a808c177aaf Sep 01 02:11:25 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:25 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b" returned: 0 in 0.261s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b2d2a4-d494-4693-a751-cb6c8fa0160b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d682f0e-2d9d-4423-8962-3bab9b416075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:25 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] Volume volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b (5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b): created successfully Sep 01 02:11:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d682f0e-2d9d-4423-8962-3bab9b416075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] Flow 'volume_create_manager' (0acb7e58-bd89-4cb9-bfe8-f2f5c0e802c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:25 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-2e5728b6-aad7-4e40-abf3-e51ea9ff0ff8 tempest-VolumesActionsTest-1606486945 None] Created volume successfully. Sep 01 02:11:25 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c0204a02-30ce-4f71-a981-cdaa16a8fda6 tempest-ProjectReaderTests-1371781335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e75e9083-15a0-45ae-9af9-2a808c177aaf" returned: 0 in 0.317s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c0204a02-30ce-4f71-a981-cdaa16a8fda6 tempest-ProjectReaderTests-1371781335 None] Lock "cinder-quobyte-e75e9083-15a0-45ae-9af9-2a808c177aaf" released by "delete_volume" :: held 0.755s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:25 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-c0204a02-30ce-4f71-a981-cdaa16a8fda6 tempest-ProjectReaderTests-1371781335 None] Created reservations ['700d61e1-cb64-45b3-bc69-1f72d05a1b2d', 'e55bf3f7-ab4a-47b0-b1bc-6c22555f8c5b', 'fafdd453-e04a-4b62-a0b4-900e87e1b8a8', '6abb374d-c6bb-4fcf-a7ea-16acd78e9339'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c0204a02-30ce-4f71-a981-cdaa16a8fda6 tempest-ProjectReaderTests-1371781335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c0204a02-30ce-4f71-a981-cdaa16a8fda6 tempest-ProjectReaderTests-1371781335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c0204a02-30ce-4f71-a981-cdaa16a8fda6 tempest-ProjectReaderTests-1371781335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c0204a02-30ce-4f71-a981-cdaa16a8fda6 tempest-ProjectReaderTests-1371781335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c0204a02-30ce-4f71-a981-cdaa16a8fda6 tempest-ProjectReaderTests-1371781335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c0204a02-30ce-4f71-a981-cdaa16a8fda6 tempest-ProjectReaderTests-1371781335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:25 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:11:25 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:25 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c0204a02-30ce-4f71-a981-cdaa16a8fda6 tempest-ProjectReaderTests-1371781335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.271s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:26 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-c0204a02-30ce-4f71-a981-cdaa16a8fda6 tempest-ProjectReaderTests-1371781335 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:26 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-c0204a02-30ce-4f71-a981-cdaa16a8fda6 tempest-ProjectReaderTests-1371781335 None] Deleted volume successfully. Sep 01 02:11:26 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c0204a02-30ce-4f71-a981-cdaa16a8fda6 tempest-ProjectReaderTests-1371781335 None] Lock "cinder-e75e9083-15a0-45ae-9af9-2a808c177aaf-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8a5e90d8-5697-4dc3-865d-ddf08aaf2c78 tempest-VolumeDependencyTests-1101719527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8a5e90d8-5697-4dc3-865d-ddf08aaf2c78 tempest-VolumeDependencyTests-1101719527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:26 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-8a5e90d8-5697-4dc3-865d-ddf08aaf2c78 tempest-VolumeDependencyTests-1101719527 None] Creating offline snapshot 600b6aa9-ed2d-419d-9147-98f6f49503b8 of volume 08f52d73-502e-463c-99ad-8f686073be2c {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:11:26 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1213e54-63c4-46d2-8737-a377d4b3c0df]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8a5e90d8-5697-4dc3-865d-ddf08aaf2c78 tempest-VolumeDependencyTests-1101719527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:26 devstack sudo[102606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c Sep 01 02:11:26 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:26 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8a5e90d8-5697-4dc3-865d-ddf08aaf2c78 tempest-VolumeDependencyTests-1101719527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c" returned: 0 in 0.366s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8a5e90d8-5697-4dc3-865d-ddf08aaf2c78 tempest-VolumeDependencyTests-1101719527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c.600b6aa9-ed2d-419d-9147-98f6f49503b8 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:26 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c.600b6aa9-ed2d-419d-9147-98f6f49503b8 1G Sep 01 02:11:26 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:27 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8a5e90d8-5697-4dc3-865d-ddf08aaf2c78 tempest-VolumeDependencyTests-1101719527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c.600b6aa9-ed2d-419d-9147-98f6f49503b8 1G" returned: 0 in 0.518s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8a5e90d8-5697-4dc3-865d-ddf08aaf2c78 tempest-VolumeDependencyTests-1101719527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08f52d73-502e-463c-99ad-8f686073be2c -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c.600b6aa9-ed2d-419d-9147-98f6f49503b8 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:27 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08f52d73-502e-463c-99ad-8f686073be2c -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c.600b6aa9-ed2d-419d-9147-98f6f49503b8 Sep 01 02:11:27 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:27 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8a5e90d8-5697-4dc3-865d-ddf08aaf2c78 tempest-VolumeDependencyTests-1101719527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08f52d73-502e-463c-99ad-8f686073be2c -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c.600b6aa9-ed2d-419d-9147-98f6f49503b8" returned: 0 in 0.371s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:27 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-8a5e90d8-5697-4dc3-865d-ddf08aaf2c78 tempest-VolumeDependencyTests-1101719527 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c.600b6aa9-ed2d-419d-9147-98f6f49503b8 is being set with open permissions: ugo+rw Sep 01 02:11:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8a5e90d8-5697-4dc3-865d-ddf08aaf2c78 tempest-VolumeDependencyTests-1101719527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c.600b6aa9-ed2d-419d-9147-98f6f49503b8 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:27 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c.600b6aa9-ed2d-419d-9147-98f6f49503b8 Sep 01 02:11:27 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:27 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8a5e90d8-5697-4dc3-865d-ddf08aaf2c78 tempest-VolumeDependencyTests-1101719527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c.600b6aa9-ed2d-419d-9147-98f6f49503b8" returned: 0 in 0.311s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8a5e90d8-5697-4dc3-865d-ddf08aaf2c78 tempest-VolumeDependencyTests-1101719527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:27 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c.info Sep 01 02:11:27 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:28 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8a5e90d8-5697-4dc3-865d-ddf08aaf2c78 tempest-VolumeDependencyTests-1101719527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c.info" returned: 0 in 0.295s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:28 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-8a5e90d8-5697-4dc3-865d-ddf08aaf2c78 tempest-VolumeDependencyTests-1101719527 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c.info is being set with open permissions: ugo+rw Sep 01 02:11:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8a5e90d8-5697-4dc3-865d-ddf08aaf2c78 tempest-VolumeDependencyTests-1101719527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:28 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c.info Sep 01 02:11:28 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:28 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8a5e90d8-5697-4dc3-865d-ddf08aaf2c78 tempest-VolumeDependencyTests-1101719527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c.info" returned: 0 in 0.290s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8a5e90d8-5697-4dc3-865d-ddf08aaf2c78 tempest-VolumeDependencyTests-1101719527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.265s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:28 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-8a5e90d8-5697-4dc3-865d-ddf08aaf2c78 tempest-VolumeDependencyTests-1101719527 None] Create snapshot completed successfully Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Flow 'volume_create_manager' (1d0d2fdf-634e-4610-aff6-67622f3a838b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (facace22-9797-4e3b-8c21-5687997ebacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (facace22-9797-4e3b-8c21-5687997ebacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1272119397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=524e8f5a-e5e7-41f1-bcfb-7099d73e8407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78981e63bbe5435ab6563beefdadfacd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=600b6aa9-ed2d-419d-9147-98f6f49503b8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:30Z,use_quota=True,user_id='34fdd7860e18459888c84ce6d2ca5627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a29ba35-282f-429a-aff2-b802d782603c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a29ba35-282f-429a-aff2-b802d782603c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ae802d4-f98c-4a37-b6ae-79b90b475c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ae802d4-f98c-4a37-b6ae-79b90b475c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '524e8f5a-e5e7-41f1-bcfb-7099d73e8407', 'volume_name': 'volume-524e8f5a-e5e7-41f1-bcfb-7099d73e8407', 'volume_size': 1, 'snapshot_id': '600b6aa9-ed2d-419d-9147-98f6f49503b8'}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a6a1c1-262d-4e69-a5da-6b063375513b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a6a1c1-262d-4e69-a5da-6b063375513b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (def08cd5-36b1-4894-9dd8-51ca233ffe4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:30 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Volume 524e8f5a-e5e7-41f1-bcfb-7099d73e8407: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-524e8f5a-e5e7-41f1-bcfb-7099d73e8407', 'volume_size': 1, 'snapshot_id': '600b6aa9-ed2d-419d-9147-98f6f49503b8'} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Acquiring lock "cinder-quobyte-600b6aa9-ed2d-419d-9147-98f6f49503b8-524e8f5a-e5e7-41f1-bcfb-7099d73e8407" by "_create_volume_from_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Lock "cinder-quobyte-600b6aa9-ed2d-419d-9147-98f6f49503b8-524e8f5a-e5e7-41f1-bcfb-7099d73e8407" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Creating volume 524e8f5a-e5e7-41f1-bcfb-7099d73e8407 from snapshot 600b6aa9-ed2d-419d-9147-98f6f49503b8 {{(pid=87128) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Acquiring lock "cinder-quobyte-524e8f5a-e5e7-41f1-bcfb-7099d73e8407" by "_copy_volume_from_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Lock "cinder-quobyte-524e8f5a-e5e7-41f1-bcfb-7099d73e8407" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] snapshot: 600b6aa9-ed2d-419d-9147-98f6f49503b8, volume: 524e8f5a-e5e7-41f1-bcfb-7099d73e8407, {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1cc9ed-a291-43d7-8124-9e86138900bf]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c.600b6aa9-ed2d-419d-9147-98f6f49503b8 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:30 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c.600b6aa9-ed2d-419d-9147-98f6f49503b8 Sep 01 02:11:30 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:30 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c.600b6aa9-ed2d-419d-9147-98f6f49503b8" returned: 0 in 0.447s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08f52d73-502e-463c-99ad-8f686073be2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:11:31 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86e2935-377a-4157-9251-3f4afef67fcb]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:31 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c Sep 01 02:11:31 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:31 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c" returned: 0 in 0.425s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:31 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:11:31 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Creating direct copy from snapshot {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:11:31 devstack cinder-volume[87128]: DEBUG cinder.utils [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Path /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-524e8f5a-e5e7-41f1-bcfb-7099d73e8407 not found in is_blk_device check {{(pid=87128) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:11:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-524e8f5a-e5e7-41f1-bcfb-7099d73e8407 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:31 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-524e8f5a-e5e7-41f1-bcfb-7099d73e8407 Sep 01 02:11:31 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:38 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-524e8f5a-e5e7-41f1-bcfb-7099d73e8407" returned: 0 in 7.158s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:38 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c, size 1024.00 MB, duration 7.16 sec, destination /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-524e8f5a-e5e7-41f1-bcfb-7099d73e8407 {{(pid=87128) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:11:38 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Converted 1024.00 MB image at 143.02 MB/s Sep 01 02:11:38 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-524e8f5a-e5e7-41f1-bcfb-7099d73e8407 is being set with open permissions: ugo+rw Sep 01 02:11:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-524e8f5a-e5e7-41f1-bcfb-7099d73e8407 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:38 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-524e8f5a-e5e7-41f1-bcfb-7099d73e8407 Sep 01 02:11:38 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:38 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2544a60e-948d-454c-89fa-9a3ba40011b0 tempest-VolumesActionsTest-1606486945 None] Acquiring lock "cinder-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b" by "attach_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:38 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2544a60e-948d-454c-89fa-9a3ba40011b0 tempest-VolumesActionsTest-1606486945 None] Lock "cinder-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b" acquired by "attach_volume" :: waited 0.026s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:38 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-524e8f5a-e5e7-41f1-bcfb-7099d73e8407" returned: 0 in 0.404s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:39 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Lock "cinder-quobyte-524e8f5a-e5e7-41f1-bcfb-7099d73e8407" released by "_copy_volume_from_snapshot" :: held 8.542s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:39 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-2544a60e-948d-454c-89fa-9a3ba40011b0 tempest-VolumesActionsTest-1606486945 None] Attaching volume 5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b to instance fc372bba-a7d1-4d6e-905a-0bcde47a5684 at mountpoint /dev/vdb on host None. Sep 01 02:11:39 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-2544a60e-948d-454c-89fa-9a3ba40011b0 tempest-VolumesActionsTest-1606486945 None] Attach volume completed successfully. Sep 01 02:11:39 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2544a60e-948d-454c-89fa-9a3ba40011b0 tempest-VolumesActionsTest-1606486945 None] Lock "cinder-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b" released by "attach_volume" :: held 0.141s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:39 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Lock "cinder-quobyte-600b6aa9-ed2d-419d-9147-98f6f49503b8-524e8f5a-e5e7-41f1-bcfb-7099d73e8407" released by "_create_volume_from_snapshot" :: held 8.658s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.681s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (def08cd5-36b1-4894-9dd8-51ca233ffe4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-524e8f5a-e5e7-41f1-bcfb-7099d73e8407', 'volume_size': 1, 'snapshot_id': '600b6aa9-ed2d-419d-9147-98f6f49503b8'}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef5a6dc-8b37-4e7d-9697-d4a4e08edefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:39 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Volume volume-524e8f5a-e5e7-41f1-bcfb-7099d73e8407 (524e8f5a-e5e7-41f1-bcfb-7099d73e8407): created successfully Sep 01 02:11:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef5a6dc-8b37-4e7d-9697-d4a4e08edefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Flow 'volume_create_manager' (1d0d2fdf-634e-4610-aff6-67622f3a838b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:39 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-de57b4b6-949a-4fc4-8273-ca035cea2604 tempest-VolumeDependencyTests-1101719527 None] Created volume successfully. Sep 01 02:11:39 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-de4ac55e-707e-4fa1-965f-ccae4ebbec7f tempest-VolumesActionsTest-1606486945 None] Acquiring lock "cinder-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b-detach_volume" by "detach_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:39 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-de4ac55e-707e-4fa1-965f-ccae4ebbec7f tempest-VolumesActionsTest-1606486945 None] Lock "cinder-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:39 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-de4ac55e-707e-4fa1-965f-ccae4ebbec7f tempest-VolumesActionsTest-1606486945 None] Detaching volume 5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b from instance fc372bba-a7d1-4d6e-905a-0bcde47a5684. Sep 01 02:11:39 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-de4ac55e-707e-4fa1-965f-ccae4ebbec7f tempest-VolumesActionsTest-1606486945 None] Detach volume completed successfully. Sep 01 02:11:39 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-de4ac55e-707e-4fa1-965f-ccae4ebbec7f tempest-VolumesActionsTest-1606486945 None] Lock "cinder-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b-detach_volume" released by "detach_volume" :: held 0.106s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:39 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-da030c99-d6ee-471a-b354-6134b865f0cd tempest-VolumeDependencyTests-1101719527 None] Acquiring lock "cinder-600b6aa9-ed2d-419d-9147-98f6f49503b8-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:39 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-da030c99-d6ee-471a-b354-6134b865f0cd tempest-VolumeDependencyTests-1101719527 None] Lock "cinder-600b6aa9-ed2d-419d-9147-98f6f49503b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:39 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-da030c99-d6ee-471a-b354-6134b865f0cd tempest-VolumeDependencyTests-1101719527 None] Acquiring lock "cinder-quobyte-08f52d73-502e-463c-99ad-8f686073be2c" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:39 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-da030c99-d6ee-471a-b354-6134b865f0cd tempest-VolumeDependencyTests-1101719527 None] Lock "cinder-quobyte-08f52d73-502e-463c-99ad-8f686073be2c" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:39 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-da030c99-d6ee-471a-b354-6134b865f0cd tempest-VolumeDependencyTests-1101719527 None] Acquiring lock "cinder-quobyte-600b6aa9-ed2d-419d-9147-98f6f49503b8" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:39 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-da030c99-d6ee-471a-b354-6134b865f0cd tempest-VolumeDependencyTests-1101719527 None] Lock "cinder-quobyte-600b6aa9-ed2d-419d-9147-98f6f49503b8" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:39 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-da030c99-d6ee-471a-b354-6134b865f0cd tempest-VolumeDependencyTests-1101719527 None] Deleting offline snapshot 600b6aa9-ed2d-419d-9147-98f6f49503b8 of volume 08f52d73-502e-463c-99ad-8f686073be2c {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:11:39 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-da030c99-d6ee-471a-b354-6134b865f0cd tempest-VolumeDependencyTests-1101719527 None] snapshot_file for this snap is: volume-08f52d73-502e-463c-99ad-8f686073be2c.600b6aa9-ed2d-419d-9147-98f6f49503b8 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:11:39 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fdd386-806c-4cfd-b06c-882b96a4c76e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-da030c99-d6ee-471a-b354-6134b865f0cd tempest-VolumeDependencyTests-1101719527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c.600b6aa9-ed2d-419d-9147-98f6f49503b8 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:40 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c.600b6aa9-ed2d-419d-9147-98f6f49503b8 Sep 01 02:11:40 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:40 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-da030c99-d6ee-471a-b354-6134b865f0cd tempest-VolumeDependencyTests-1101719527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c.600b6aa9-ed2d-419d-9147-98f6f49503b8" returned: 0 in 0.640s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:40 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-da030c99-d6ee-471a-b354-6134b865f0cd tempest-VolumeDependencyTests-1101719527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08f52d73-502e-463c-99ad-8f686073be2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:11:40 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[7641828a-3c5e-45a9-a90a-4896f68b821e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-da030c99-d6ee-471a-b354-6134b865f0cd tempest-VolumeDependencyTests-1101719527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:40 devstack sudo[102780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c Sep 01 02:11:40 devstack sudo[102780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:41 devstack sudo[102780]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-da030c99-d6ee-471a-b354-6134b865f0cd tempest-VolumeDependencyTests-1101719527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c" returned: 0 in 0.612s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-da030c99-d6ee-471a-b354-6134b865f0cd tempest-VolumeDependencyTests-1101719527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c.600b6aa9-ed2d-419d-9147-98f6f49503b8 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:41 devstack sudo[102787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c.600b6aa9-ed2d-419d-9147-98f6f49503b8 Sep 01 02:11:41 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:41 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-da030c99-d6ee-471a-b354-6134b865f0cd tempest-VolumeDependencyTests-1101719527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c.600b6aa9-ed2d-419d-9147-98f6f49503b8" returned: 0 in 0.444s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-da030c99-d6ee-471a-b354-6134b865f0cd tempest-VolumeDependencyTests-1101719527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c.600b6aa9-ed2d-419d-9147-98f6f49503b8 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:41 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c.600b6aa9-ed2d-419d-9147-98f6f49503b8 Sep 01 02:11:41 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:41 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-da030c99-d6ee-471a-b354-6134b865f0cd tempest-VolumeDependencyTests-1101719527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c.600b6aa9-ed2d-419d-9147-98f6f49503b8" returned: 0 in 0.298s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:42 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-da030c99-d6ee-471a-b354-6134b865f0cd tempest-VolumeDependencyTests-1101719527 None] Lock "cinder-quobyte-600b6aa9-ed2d-419d-9147-98f6f49503b8" released by "_delete_snapshot" :: held 2.216s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:42 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-da030c99-d6ee-471a-b354-6134b865f0cd tempest-VolumeDependencyTests-1101719527 None] Lock "cinder-quobyte-08f52d73-502e-463c-99ad-8f686073be2c" released by "delete_snapshot" :: held 2.260s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:42 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-da030c99-d6ee-471a-b354-6134b865f0cd tempest-VolumeDependencyTests-1101719527 None] Created reservations ['06647b7b-eb52-438d-8bdb-9d7c97790fe7', '473d701f-f59f-4906-b8cd-992364ece097', 'd8351ace-f543-4372-8cdb-68c4999bc3f6', '5cff8d64-cbed-40d6-bcfe-a588b2b4297b'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:42 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-da030c99-d6ee-471a-b354-6134b865f0cd tempest-VolumeDependencyTests-1101719527 None] Delete snapshot completed successfully. Sep 01 02:11:42 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-da030c99-d6ee-471a-b354-6134b865f0cd tempest-VolumeDependencyTests-1101719527 None] Lock "cinder-600b6aa9-ed2d-419d-9147-98f6f49503b8-delete_snapshot" released by "delete_snapshot" :: held 2.587s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:43 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-478f7d2f-675a-48e7-ad1a-4aa42c757ac8 tempest-VolumeDependencyTests-1101719527 None] Acquiring lock "cinder-08f52d73-502e-463c-99ad-8f686073be2c-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:43 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-478f7d2f-675a-48e7-ad1a-4aa42c757ac8 tempest-VolumeDependencyTests-1101719527 None] Lock "cinder-08f52d73-502e-463c-99ad-8f686073be2c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:43 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-478f7d2f-675a-48e7-ad1a-4aa42c757ac8 tempest-VolumeDependencyTests-1101719527 None] Acquiring lock "cinder-quobyte-08f52d73-502e-463c-99ad-8f686073be2c" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:43 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-478f7d2f-675a-48e7-ad1a-4aa42c757ac8 tempest-VolumeDependencyTests-1101719527 None] Lock "cinder-quobyte-08f52d73-502e-463c-99ad-8f686073be2c" acquired by "delete_volume" :: waited 0.027s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:43 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd14199-795c-4941-9bc8-8411d372e10d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-478f7d2f-675a-48e7-ad1a-4aa42c757ac8 tempest-VolumeDependencyTests-1101719527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:43 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c Sep 01 02:11:43 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:43 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-478f7d2f-675a-48e7-ad1a-4aa42c757ac8 tempest-VolumeDependencyTests-1101719527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c" returned: 0 in 0.554s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-478f7d2f-675a-48e7-ad1a-4aa42c757ac8 tempest-VolumeDependencyTests-1101719527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:43 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c Sep 01 02:11:43 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:44 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-478f7d2f-675a-48e7-ad1a-4aa42c757ac8 tempest-VolumeDependencyTests-1101719527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f52d73-502e-463c-99ad-8f686073be2c" returned: 0 in 0.308s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:44 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-478f7d2f-675a-48e7-ad1a-4aa42c757ac8 tempest-VolumeDependencyTests-1101719527 None] Lock "cinder-quobyte-08f52d73-502e-463c-99ad-8f686073be2c" released by "delete_volume" :: held 0.976s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:44 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-478f7d2f-675a-48e7-ad1a-4aa42c757ac8 tempest-VolumeDependencyTests-1101719527 None] Created reservations ['5578df98-6196-4a56-a50e-5fb47de348d8', '707a214f-1735-46e4-a896-71bbb090d7be', '3ff1a2d2-f8d5-4f64-8ecc-74bac594d9a2', '4e6db491-4204-40ba-b08b-b449159ec84f'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-478f7d2f-675a-48e7-ad1a-4aa42c757ac8 tempest-VolumeDependencyTests-1101719527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-478f7d2f-675a-48e7-ad1a-4aa42c757ac8 tempest-VolumeDependencyTests-1101719527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:44 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-478f7d2f-675a-48e7-ad1a-4aa42c757ac8 tempest-VolumeDependencyTests-1101719527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:44 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-478f7d2f-675a-48e7-ad1a-4aa42c757ac8 tempest-VolumeDependencyTests-1101719527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-478f7d2f-675a-48e7-ad1a-4aa42c757ac8 tempest-VolumeDependencyTests-1101719527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-478f7d2f-675a-48e7-ad1a-4aa42c757ac8 tempest-VolumeDependencyTests-1101719527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:44 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:11:44 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:44 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-478f7d2f-675a-48e7-ad1a-4aa42c757ac8 tempest-VolumeDependencyTests-1101719527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.306s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:44 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-478f7d2f-675a-48e7-ad1a-4aa42c757ac8 tempest-VolumeDependencyTests-1101719527 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:44 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-478f7d2f-675a-48e7-ad1a-4aa42c757ac8 tempest-VolumeDependencyTests-1101719527 None] Deleted volume successfully. Sep 01 02:11:44 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-478f7d2f-675a-48e7-ad1a-4aa42c757ac8 tempest-VolumeDependencyTests-1101719527 None] Lock "cinder-08f52d73-502e-463c-99ad-8f686073be2c-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:45 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7031f2f6-db14-4909-b400-1bf53c5244ed tempest-VolumeDependencyTests-1101719527 None] Acquiring lock "cinder-524e8f5a-e5e7-41f1-bcfb-7099d73e8407-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:45 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7031f2f6-db14-4909-b400-1bf53c5244ed tempest-VolumeDependencyTests-1101719527 None] Lock "cinder-524e8f5a-e5e7-41f1-bcfb-7099d73e8407-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:45 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7031f2f6-db14-4909-b400-1bf53c5244ed tempest-VolumeDependencyTests-1101719527 None] Acquiring lock "cinder-quobyte-524e8f5a-e5e7-41f1-bcfb-7099d73e8407" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:45 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7031f2f6-db14-4909-b400-1bf53c5244ed tempest-VolumeDependencyTests-1101719527 None] Lock "cinder-quobyte-524e8f5a-e5e7-41f1-bcfb-7099d73e8407" acquired by "delete_volume" :: waited 0.027s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:45 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17d0c73-9fd7-40b3-ad28-cd7b0816e1f3]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7031f2f6-db14-4909-b400-1bf53c5244ed tempest-VolumeDependencyTests-1101719527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-524e8f5a-e5e7-41f1-bcfb-7099d73e8407 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:45 devstack sudo[102814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-524e8f5a-e5e7-41f1-bcfb-7099d73e8407 Sep 01 02:11:45 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:46 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7031f2f6-db14-4909-b400-1bf53c5244ed tempest-VolumeDependencyTests-1101719527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-524e8f5a-e5e7-41f1-bcfb-7099d73e8407" returned: 0 in 0.590s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7031f2f6-db14-4909-b400-1bf53c5244ed tempest-VolumeDependencyTests-1101719527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-524e8f5a-e5e7-41f1-bcfb-7099d73e8407 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:46 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-524e8f5a-e5e7-41f1-bcfb-7099d73e8407 Sep 01 02:11:46 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:46 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7031f2f6-db14-4909-b400-1bf53c5244ed tempest-VolumeDependencyTests-1101719527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-524e8f5a-e5e7-41f1-bcfb-7099d73e8407" returned: 0 in 0.293s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7031f2f6-db14-4909-b400-1bf53c5244ed tempest-VolumeDependencyTests-1101719527 None] Lock "cinder-quobyte-524e8f5a-e5e7-41f1-bcfb-7099d73e8407" released by "delete_volume" :: held 0.944s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:46 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-7031f2f6-db14-4909-b400-1bf53c5244ed tempest-VolumeDependencyTests-1101719527 None] Created reservations ['fb83fcb0-5343-4f48-a1f7-2833ffcbe39c', '37b86d8e-ca6d-4574-813e-253ca116a819', '90a02ce5-fc33-4047-bd39-0af2ab3b3a11', '888b252b-1e48-452e-b9be-66b99fbed4e8'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7031f2f6-db14-4909-b400-1bf53c5244ed tempest-VolumeDependencyTests-1101719527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7031f2f6-db14-4909-b400-1bf53c5244ed tempest-VolumeDependencyTests-1101719527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:47 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7031f2f6-db14-4909-b400-1bf53c5244ed tempest-VolumeDependencyTests-1101719527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:47 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7031f2f6-db14-4909-b400-1bf53c5244ed tempest-VolumeDependencyTests-1101719527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7031f2f6-db14-4909-b400-1bf53c5244ed tempest-VolumeDependencyTests-1101719527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7031f2f6-db14-4909-b400-1bf53c5244ed tempest-VolumeDependencyTests-1101719527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:47 devstack sudo[102822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:11:47 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:47 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7031f2f6-db14-4909-b400-1bf53c5244ed tempest-VolumeDependencyTests-1101719527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.303s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:47 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-7031f2f6-db14-4909-b400-1bf53c5244ed tempest-VolumeDependencyTests-1101719527 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:47 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-7031f2f6-db14-4909-b400-1bf53c5244ed tempest-VolumeDependencyTests-1101719527 None] Deleted volume successfully. Sep 01 02:11:47 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7031f2f6-db14-4909-b400-1bf53c5244ed tempest-VolumeDependencyTests-1101719527 None] Lock "cinder-524e8f5a-e5e7-41f1-bcfb-7099d73e8407-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:56 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-79f93cea-705b-4d7d-9b1c-2a970d31c883 tempest-VolumesActionsTest-1606486945 None] Acquiring lock "cinder-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b" by "attach_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:56 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-79f93cea-705b-4d7d-9b1c-2a970d31c883 tempest-VolumesActionsTest-1606486945 None] Lock "cinder-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b" acquired by "attach_volume" :: waited 0.023s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:56 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-79f93cea-705b-4d7d-9b1c-2a970d31c883 tempest-VolumesActionsTest-1606486945 None] Attaching volume 5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b to instance 82a4aebb-c10a-40f2-887d-5dcd6cf35f20 at mountpoint /dev/vdb on host None. Sep 01 02:11:56 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-79f93cea-705b-4d7d-9b1c-2a970d31c883 tempest-VolumesActionsTest-1606486945 None] Attach volume completed successfully. Sep 01 02:11:56 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-79f93cea-705b-4d7d-9b1c-2a970d31c883 tempest-VolumesActionsTest-1606486945 None] Lock "cinder-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b" released by "attach_volume" :: held 0.118s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-46819bec-daba-4e39-87a1-db002c206647 tempest-VolumesActionsTest-1606486945 None] Acquiring lock "cinder-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b-detach_volume" by "detach_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-46819bec-daba-4e39-87a1-db002c206647 tempest-VolumesActionsTest-1606486945 None] Lock "cinder-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:57 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-46819bec-daba-4e39-87a1-db002c206647 tempest-VolumesActionsTest-1606486945 None] Detaching volume 5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b from instance 82a4aebb-c10a-40f2-887d-5dcd6cf35f20. Sep 01 02:11:57 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-46819bec-daba-4e39-87a1-db002c206647 tempest-VolumesActionsTest-1606486945 None] Detach volume completed successfully. Sep 01 02:11:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-46819bec-daba-4e39-87a1-db002c206647 tempest-VolumesActionsTest-1606486945 None] Lock "cinder-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b-detach_volume" released by "detach_volume" :: held 0.131s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:57 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:11:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] Flow 'volume_create_manager' (64a9c715-514e-4ec9-93d7-2202f61ca238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a6fa747-e43a-4bed-b2eb-da2ac7300d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a6fa747-e43a-4bed-b2eb-da2ac7300d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1077613779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c890b47-6f55-4825-8985-b7e141191093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a22a6fb78ee4ad282ede44cdb8e52ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:58Z,use_quota=True,user_id='8d7519ffd47c48ff81087d20306b3d1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (773fd767-2a8c-4795-b93e-7343de602c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (773fd767-2a8c-4795-b93e-7343de602c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d67360-9363-44c0-8c8f-941da7b52b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d67360-9363-44c0-8c8f-941da7b52b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c890b47-6f55-4825-8985-b7e141191093', 'volume_name': 'volume-7c890b47-6f55-4825-8985-b7e141191093', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0675a37-7b0a-4caf-adad-16760244934b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0675a37-7b0a-4caf-adad-16760244934b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e5dce2-6021-4318-b5ed-a5cf6a7e2176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:57 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] Volume 7c890b47-6f55-4825-8985-b7e141191093: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c890b47-6f55-4825-8985-b7e141191093', 'volume_size': 1} Sep 01 02:11:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1077613779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c890b47-6f55-4825-8985-b7e141191093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a22a6fb78ee4ad282ede44cdb8e52ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:58Z,use_quota=True,user_id='8d7519ffd47c48ff81087d20306b3d1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] Creating volume 7c890b47-6f55-4825-8985-b7e141191093 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:57 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:11:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:57 devstack sudo[102911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093 1073741824 Sep 01 02:11:57 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:58 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093 1073741824" returned: 0 in 0.556s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:58 devstack sudo[102932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093 Sep 01 02:11:58 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:58 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093" returned: 0 in 0.272s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e5dce2-6021-4318-b5ed-a5cf6a7e2176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c890b47-6f55-4825-8985-b7e141191093', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b477b057-6705-43b1-8877-1b307f7fd811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:58 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] Volume volume-7c890b47-6f55-4825-8985-b7e141191093 (7c890b47-6f55-4825-8985-b7e141191093): created successfully Sep 01 02:11:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b477b057-6705-43b1-8877-1b307f7fd811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] Flow 'volume_create_manager' (64a9c715-514e-4ec9-93d7-2202f61ca238) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:58 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-1bc2e4c0-e6fc-4375-a21d-1ec7cd4996b0 tempest-SnapshotDependencyTests-2014402934 None] Created volume successfully. Sep 01 02:11:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-895b3b14-9620-43c4-8d19-0d692a66d946 tempest-SnapshotDependencyTests-2014402934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-895b3b14-9620-43c4-8d19-0d692a66d946 tempest-SnapshotDependencyTests-2014402934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:59 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-895b3b14-9620-43c4-8d19-0d692a66d946 tempest-SnapshotDependencyTests-2014402934 None] Creating offline snapshot e24157f1-3433-49b4-b252-50cf7e890a04 of volume 7c890b47-6f55-4825-8985-b7e141191093 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:11:59 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b67ba7e-2874-4b5c-9bc0-b85691bba141]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-895b3b14-9620-43c4-8d19-0d692a66d946 tempest-SnapshotDependencyTests-2014402934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:59 devstack sudo[102945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093 Sep 01 02:11:59 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:00 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-895b3b14-9620-43c4-8d19-0d692a66d946 tempest-SnapshotDependencyTests-2014402934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093" returned: 0 in 0.341s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-895b3b14-9620-43c4-8d19-0d692a66d946 tempest-SnapshotDependencyTests-2014402934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093.e24157f1-3433-49b4-b252-50cf7e890a04 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:00 devstack sudo[102950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093.e24157f1-3433-49b4-b252-50cf7e890a04 1G Sep 01 02:12:00 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:00 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-895b3b14-9620-43c4-8d19-0d692a66d946 tempest-SnapshotDependencyTests-2014402934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093.e24157f1-3433-49b4-b252-50cf7e890a04 1G" returned: 0 in 0.416s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-895b3b14-9620-43c4-8d19-0d692a66d946 tempest-SnapshotDependencyTests-2014402934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c890b47-6f55-4825-8985-b7e141191093 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093.e24157f1-3433-49b4-b252-50cf7e890a04 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:00 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c890b47-6f55-4825-8985-b7e141191093 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093.e24157f1-3433-49b4-b252-50cf7e890a04 Sep 01 02:12:00 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:00 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-895b3b14-9620-43c4-8d19-0d692a66d946 tempest-SnapshotDependencyTests-2014402934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c890b47-6f55-4825-8985-b7e141191093 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093.e24157f1-3433-49b4-b252-50cf7e890a04" returned: 0 in 0.331s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:00 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-895b3b14-9620-43c4-8d19-0d692a66d946 tempest-SnapshotDependencyTests-2014402934 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093.e24157f1-3433-49b4-b252-50cf7e890a04 is being set with open permissions: ugo+rw Sep 01 02:12:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-895b3b14-9620-43c4-8d19-0d692a66d946 tempest-SnapshotDependencyTests-2014402934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093.e24157f1-3433-49b4-b252-50cf7e890a04 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:00 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093.e24157f1-3433-49b4-b252-50cf7e890a04 Sep 01 02:12:00 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:01 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-895b3b14-9620-43c4-8d19-0d692a66d946 tempest-SnapshotDependencyTests-2014402934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093.e24157f1-3433-49b4-b252-50cf7e890a04" returned: 0 in 0.269s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-895b3b14-9620-43c4-8d19-0d692a66d946 tempest-SnapshotDependencyTests-2014402934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:01 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093.info Sep 01 02:12:01 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:01 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-895b3b14-9620-43c4-8d19-0d692a66d946 tempest-SnapshotDependencyTests-2014402934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093.info" returned: 0 in 0.256s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:01 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-895b3b14-9620-43c4-8d19-0d692a66d946 tempest-SnapshotDependencyTests-2014402934 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093.info is being set with open permissions: ugo+rw Sep 01 02:12:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-895b3b14-9620-43c4-8d19-0d692a66d946 tempest-SnapshotDependencyTests-2014402934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:01 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093.info Sep 01 02:12:01 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:01 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-895b3b14-9620-43c4-8d19-0d692a66d946 tempest-SnapshotDependencyTests-2014402934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093.info" returned: 0 in 0.246s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-895b3b14-9620-43c4-8d19-0d692a66d946 tempest-SnapshotDependencyTests-2014402934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.948s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:01 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-895b3b14-9620-43c4-8d19-0d692a66d946 tempest-SnapshotDependencyTests-2014402934 None] Create snapshot completed successfully Sep 01 02:12:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-51793f88-363d-4846-9c12-feb025751ce1 tempest-VolumesActionsTest-1606486945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-51793f88-363d-4846-9c12-feb025751ce1 tempest-VolumesActionsTest-1606486945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:02 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bd85c6-a276-4f1f-a7f9-a42eb05082fc]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51793f88-363d-4846-9c12-feb025751ce1 tempest-VolumesActionsTest-1606486945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:02 devstack sudo[102971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b Sep 01 02:12:02 devstack sudo[102971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:02 devstack sudo[102971]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51793f88-363d-4846-9c12-feb025751ce1 tempest-VolumesActionsTest-1606486945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b" returned: 0 in 0.378s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:02 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee3f31b-fff5-4ca2-b466-c9f200d82243]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51793f88-363d-4846-9c12-feb025751ce1 tempest-VolumesActionsTest-1606486945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:02 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:02 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b Sep 01 02:12:02 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Flow 'volume_create_manager' (2d4cc911-6936-493a-8794-1d27c746ddcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30413c5c-a91c-49f2-90fb-39b8c41e3777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30413c5c-a91c-49f2-90fb-39b8c41e3777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5186d04-9b5f-47df-843f-5e94e9561585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a22a6fb78ee4ad282ede44cdb8e52ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e24157f1-3433-49b4-b252-50cf7e890a04,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:03Z,use_quota=True,user_id='8d7519ffd47c48ff81087d20306b3d1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cbde6ec-1677-4c47-a5f5-d1702836110c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cbde6ec-1677-4c47-a5f5-d1702836110c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fa2426a-e042-4654-abc8-e424eb8be785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fa2426a-e042-4654-abc8-e424eb8be785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c5186d04-9b5f-47df-843f-5e94e9561585', 'volume_name': 'volume-c5186d04-9b5f-47df-843f-5e94e9561585', 'volume_size': 1, 'snapshot_id': 'e24157f1-3433-49b4-b252-50cf7e890a04'}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0423a6f5-8589-46f8-85a7-d9b134c55343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0423a6f5-8589-46f8-85a7-d9b134c55343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c5bc06a-394e-41aa-ac8d-65b1553b295e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:02 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Volume c5186d04-9b5f-47df-843f-5e94e9561585: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c5186d04-9b5f-47df-843f-5e94e9561585', 'volume_size': 1, 'snapshot_id': 'e24157f1-3433-49b4-b252-50cf7e890a04'} Sep 01 02:12:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:02 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51793f88-363d-4846-9c12-feb025751ce1 tempest-VolumesActionsTest-1606486945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b" returned: 0 in 0.356s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51793f88-363d-4846-9c12-feb025751ce1 tempest-VolumesActionsTest-1606486945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b /opt/stack/data/cinder/conversion/5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b.temp_image.3cd622ff-4cb3-4dda-a579-55c0b67e3e09dm4lx91o.img {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:02 devstack sudo[102981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b /opt/stack/data/cinder/conversion/5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b.temp_image.3cd622ff-4cb3-4dda-a579-55c0b67e3e09dm4lx91o.img Sep 01 02:12:02 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:06 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51793f88-363d-4846-9c12-feb025751ce1 tempest-VolumesActionsTest-1606486945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b /opt/stack/data/cinder/conversion/5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b.temp_image.3cd622ff-4cb3-4dda-a579-55c0b67e3e09dm4lx91o.img" returned: 0 in 3.601s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:06 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d1a626-a6a0-4bf4-b32e-4560ac2c2ceb]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51793f88-363d-4846-9c12-feb025751ce1 tempest-VolumesActionsTest-1606486945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:06 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b Sep 01 02:12:06 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:06 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51793f88-363d-4846-9c12-feb025751ce1 tempest-VolumesActionsTest-1606486945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b" returned: 0 in 0.500s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:06 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-51793f88-363d-4846-9c12-feb025751ce1 tempest-VolumesActionsTest-1606486945 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b, size 1024.00 MB, duration 3.60 sec, destination /opt/stack/data/cinder/conversion/5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b.temp_image.3cd622ff-4cb3-4dda-a579-55c0b67e3e09dm4lx91o.img {{(pid=87128) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:12:06 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-51793f88-363d-4846-9c12-feb025751ce1 tempest-VolumesActionsTest-1606486945 None] Converted 1024.00 MB image at 284.27 MB/s Sep 01 02:12:06 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-51793f88-363d-4846-9c12-feb025751ce1 tempest-VolumesActionsTest-1606486945 None] 3cd622ff-4cb3-4dda-a579-55c0b67e3e09 was raw, no need to convert to raw {{(pid=87128) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 01 02:12:16 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:UPDATE=133,cinder:DELETE=12,cinder:SELECT=112,cinder:INSERT=34 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:12:16 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=81,cinder:INSERT=25,cinder:UPDATE=97,cinder:DELETE=8 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:12:16 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:12:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:17 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:12:17 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:17 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.270s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:17 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:17 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager._thread_info {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:12:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread count: 29 {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:12:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread info: [<_MainThread(MainThread, started 128688016527488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:12:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-51793f88-363d-4846-9c12-feb025751ce1 tempest-VolumesActionsTest-1606486945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 23.667s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-51793f88-363d-4846-9c12-feb025751ce1 tempest-VolumesActionsTest-1606486945 None] Uploaded volume to glance image-id: 3cd622ff-4cb3-4dda-a579-55c0b67e3e09. {{(pid=87128) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 02:12:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 23.058s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Acquiring lock "cinder-quobyte-e24157f1-3433-49b4-b252-50cf7e890a04-c5186d04-9b5f-47df-843f-5e94e9561585" by "_create_volume_from_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Lock "cinder-quobyte-e24157f1-3433-49b4-b252-50cf7e890a04-c5186d04-9b5f-47df-843f-5e94e9561585" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Creating volume c5186d04-9b5f-47df-843f-5e94e9561585 from snapshot e24157f1-3433-49b4-b252-50cf7e890a04 {{(pid=87128) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:12:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Acquiring lock "cinder-quobyte-c5186d04-9b5f-47df-843f-5e94e9561585" by "_copy_volume_from_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:25 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-51793f88-363d-4846-9c12-feb025751ce1 tempest-VolumesActionsTest-1606486945 None] Copy volume to image completed successfully. Sep 01 02:12:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Lock "cinder-quobyte-c5186d04-9b5f-47df-843f-5e94e9561585" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] snapshot: e24157f1-3433-49b4-b252-50cf7e890a04, volume: c5186d04-9b5f-47df-843f-5e94e9561585, {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:12:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:25 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d13e43-8e9d-4118-aa4f-72a4303334f6]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093.e24157f1-3433-49b4-b252-50cf7e890a04 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:25 devstack sudo[103041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093.e24157f1-3433-49b4-b252-50cf7e890a04 Sep 01 02:12:25 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:26 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093.e24157f1-3433-49b4-b252-50cf7e890a04" returned: 0 in 0.437s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:26 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c890b47-6f55-4825-8985-b7e141191093(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:26 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de3f3cd-e854-40a4-9245-c07fb02d70a5]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:26 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093 Sep 01 02:12:26 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:26 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093" returned: 0 in 0.372s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:26 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093 {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:12:26 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Creating direct copy from snapshot {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:12:26 devstack cinder-volume[87128]: DEBUG cinder.utils [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Path /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c5186d04-9b5f-47df-843f-5e94e9561585 not found in is_blk_device check {{(pid=87128) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:12:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c5186d04-9b5f-47df-843f-5e94e9561585 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:26 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c5186d04-9b5f-47df-843f-5e94e9561585 Sep 01 02:12:26 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9f4c71ff-a6f0-48ba-9b43-015d27721ded tempest-VolumesActionsTest-1606486945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:30 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c5186d04-9b5f-47df-843f-5e94e9561585" returned: 0 in 4.002s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:30 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093, size 1024.00 MB, duration 4.00 sec, destination /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c5186d04-9b5f-47df-843f-5e94e9561585 {{(pid=87128) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:12:30 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Converted 1024.00 MB image at 255.79 MB/s Sep 01 02:12:30 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c5186d04-9b5f-47df-843f-5e94e9561585 is being set with open permissions: ugo+rw Sep 01 02:12:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c5186d04-9b5f-47df-843f-5e94e9561585 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:30 devstack sudo[103072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c5186d04-9b5f-47df-843f-5e94e9561585 Sep 01 02:12:30 devstack sudo[103072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:30 devstack sudo[103072]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c5186d04-9b5f-47df-843f-5e94e9561585" returned: 0 in 0.242s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:30 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Lock "cinder-quobyte-c5186d04-9b5f-47df-843f-5e94e9561585" released by "_copy_volume_from_snapshot" :: held 5.137s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:30 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Lock "cinder-quobyte-e24157f1-3433-49b4-b252-50cf7e890a04-c5186d04-9b5f-47df-843f-5e94e9561585" released by "_create_volume_from_snapshot" :: held 5.205s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.234s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9f4c71ff-a6f0-48ba-9b43-015d27721ded tempest-VolumesActionsTest-1606486945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 4.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:31 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aaeac03-4995-4cd7-b893-93066f046242]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9f4c71ff-a6f0-48ba-9b43-015d27721ded tempest-VolumesActionsTest-1606486945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c5bc06a-394e-41aa-ac8d-65b1553b295e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5186d04-9b5f-47df-843f-5e94e9561585', 'volume_size': 1, 'snapshot_id': 'e24157f1-3433-49b4-b252-50cf7e890a04'}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37bb931-b52f-4a70-8b16-23d91b55dc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:31 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Volume volume-c5186d04-9b5f-47df-843f-5e94e9561585 (c5186d04-9b5f-47df-843f-5e94e9561585): created successfully Sep 01 02:12:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37bb931-b52f-4a70-8b16-23d91b55dc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Flow 'volume_create_manager' (2d4cc911-6936-493a-8794-1d27c746ddcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:31 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-0efa433f-7d6c-41f4-b24a-b9342792619d tempest-SnapshotDependencyTests-2014402934 None] Created volume successfully. Sep 01 02:12:31 devstack sudo[103075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b Sep 01 02:12:31 devstack sudo[103075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:31 devstack sudo[103075]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9f4c71ff-a6f0-48ba-9b43-015d27721ded tempest-VolumesActionsTest-1606486945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b" returned: 0 in 0.440s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:31 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[6370416e-4304-471d-b34d-4e07deadab68]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9f4c71ff-a6f0-48ba-9b43-015d27721ded tempest-VolumesActionsTest-1606486945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:31 devstack sudo[103080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b Sep 01 02:12:31 devstack sudo[103080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:31 devstack sudo[103080]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9f4c71ff-a6f0-48ba-9b43-015d27721ded tempest-VolumesActionsTest-1606486945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b" returned: 0 in 0.378s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9f4c71ff-a6f0-48ba-9b43-015d27721ded tempest-VolumesActionsTest-1606486945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b /opt/stack/data/cinder/conversion/5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b.temp_image.7ee6cee0-be22-468b-9e92-86e176ddabc9pxnwqsbr.img {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:31 devstack sudo[103086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b /opt/stack/data/cinder/conversion/5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b.temp_image.7ee6cee0-be22-468b-9e92-86e176ddabc9pxnwqsbr.img Sep 01 02:12:31 devstack sudo[103086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:31 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-136d112e-cefa-4e27-ac5e-b4aedc4574b8 tempest-SnapshotDependencyTests-2014402934 None] Acquiring lock "cinder-e24157f1-3433-49b4-b252-50cf7e890a04-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:31 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-136d112e-cefa-4e27-ac5e-b4aedc4574b8 tempest-SnapshotDependencyTests-2014402934 None] Lock "cinder-e24157f1-3433-49b4-b252-50cf7e890a04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:31 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-136d112e-cefa-4e27-ac5e-b4aedc4574b8 tempest-SnapshotDependencyTests-2014402934 None] Acquiring lock "cinder-quobyte-7c890b47-6f55-4825-8985-b7e141191093" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:31 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-136d112e-cefa-4e27-ac5e-b4aedc4574b8 tempest-SnapshotDependencyTests-2014402934 None] Lock "cinder-quobyte-7c890b47-6f55-4825-8985-b7e141191093" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:31 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-136d112e-cefa-4e27-ac5e-b4aedc4574b8 tempest-SnapshotDependencyTests-2014402934 None] Acquiring lock "cinder-quobyte-e24157f1-3433-49b4-b252-50cf7e890a04" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:31 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-136d112e-cefa-4e27-ac5e-b4aedc4574b8 tempest-SnapshotDependencyTests-2014402934 None] Lock "cinder-quobyte-e24157f1-3433-49b4-b252-50cf7e890a04" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:31 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-136d112e-cefa-4e27-ac5e-b4aedc4574b8 tempest-SnapshotDependencyTests-2014402934 None] Deleting offline snapshot e24157f1-3433-49b4-b252-50cf7e890a04 of volume 7c890b47-6f55-4825-8985-b7e141191093 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:12:31 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-136d112e-cefa-4e27-ac5e-b4aedc4574b8 tempest-SnapshotDependencyTests-2014402934 None] snapshot_file for this snap is: volume-7c890b47-6f55-4825-8985-b7e141191093.e24157f1-3433-49b4-b252-50cf7e890a04 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:12:31 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fab6466-9933-45b6-922b-1ae7fd934e7f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-136d112e-cefa-4e27-ac5e-b4aedc4574b8 tempest-SnapshotDependencyTests-2014402934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093.e24157f1-3433-49b4-b252-50cf7e890a04 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:32 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093.e24157f1-3433-49b4-b252-50cf7e890a04 Sep 01 02:12:32 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:32 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-136d112e-cefa-4e27-ac5e-b4aedc4574b8 tempest-SnapshotDependencyTests-2014402934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093.e24157f1-3433-49b4-b252-50cf7e890a04" returned: 0 in 0.732s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:32 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-136d112e-cefa-4e27-ac5e-b4aedc4574b8 tempest-SnapshotDependencyTests-2014402934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c890b47-6f55-4825-8985-b7e141191093(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:32 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fda904-9a7a-41da-9e07-cad949435841]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-136d112e-cefa-4e27-ac5e-b4aedc4574b8 tempest-SnapshotDependencyTests-2014402934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:33 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093 Sep 01 02:12:33 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:33 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-136d112e-cefa-4e27-ac5e-b4aedc4574b8 tempest-SnapshotDependencyTests-2014402934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093" returned: 0 in 0.988s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-136d112e-cefa-4e27-ac5e-b4aedc4574b8 tempest-SnapshotDependencyTests-2014402934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093.e24157f1-3433-49b4-b252-50cf7e890a04 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:33 devstack sudo[103108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093.e24157f1-3433-49b4-b252-50cf7e890a04 Sep 01 02:12:33 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:34 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-136d112e-cefa-4e27-ac5e-b4aedc4574b8 tempest-SnapshotDependencyTests-2014402934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093.e24157f1-3433-49b4-b252-50cf7e890a04" returned: 0 in 0.862s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-136d112e-cefa-4e27-ac5e-b4aedc4574b8 tempest-SnapshotDependencyTests-2014402934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093.e24157f1-3433-49b4-b252-50cf7e890a04 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:34 devstack sudo[103115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093.e24157f1-3433-49b4-b252-50cf7e890a04 Sep 01 02:12:34 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:35 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-136d112e-cefa-4e27-ac5e-b4aedc4574b8 tempest-SnapshotDependencyTests-2014402934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093.e24157f1-3433-49b4-b252-50cf7e890a04" returned: 0 in 0.541s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-136d112e-cefa-4e27-ac5e-b4aedc4574b8 tempest-SnapshotDependencyTests-2014402934 None] Lock "cinder-quobyte-e24157f1-3433-49b4-b252-50cf7e890a04" released by "_delete_snapshot" :: held 3.322s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-136d112e-cefa-4e27-ac5e-b4aedc4574b8 tempest-SnapshotDependencyTests-2014402934 None] Lock "cinder-quobyte-7c890b47-6f55-4825-8985-b7e141191093" released by "delete_snapshot" :: held 3.359s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:35 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-136d112e-cefa-4e27-ac5e-b4aedc4574b8 tempest-SnapshotDependencyTests-2014402934 None] Created reservations ['c3cd25cc-6c7b-4f38-b510-2c367bda5bb0', 'f2a194b0-f795-460b-bfec-dc6470f805ae', '33aeb794-bbb0-4519-9d81-7db5dbd57767', 'f817d39f-b12b-446a-9e16-e512198000f3'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:35 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-136d112e-cefa-4e27-ac5e-b4aedc4574b8 tempest-SnapshotDependencyTests-2014402934 None] Delete snapshot completed successfully. Sep 01 02:12:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-136d112e-cefa-4e27-ac5e-b4aedc4574b8 tempest-SnapshotDependencyTests-2014402934 None] Lock "cinder-e24157f1-3433-49b4-b252-50cf7e890a04-delete_snapshot" released by "delete_snapshot" :: held 3.745s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:35 devstack sudo[103086]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9f4c71ff-a6f0-48ba-9b43-015d27721ded tempest-VolumesActionsTest-1606486945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b /opt/stack/data/cinder/conversion/5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b.temp_image.7ee6cee0-be22-468b-9e92-86e176ddabc9pxnwqsbr.img" returned: 0 in 4.078s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:35 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c904ce8-244a-4236-8e17-f42e6bf94d32]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9f4c71ff-a6f0-48ba-9b43-015d27721ded tempest-VolumesActionsTest-1606486945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:36 devstack sudo[103119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b Sep 01 02:12:36 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fd0ded75-9d58-4aed-bca4-a4ce3ae7f32d tempest-SnapshotDependencyTests-2014402934 None] Acquiring lock "cinder-7c890b47-6f55-4825-8985-b7e141191093-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fd0ded75-9d58-4aed-bca4-a4ce3ae7f32d tempest-SnapshotDependencyTests-2014402934 None] Lock "cinder-7c890b47-6f55-4825-8985-b7e141191093-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fd0ded75-9d58-4aed-bca4-a4ce3ae7f32d tempest-SnapshotDependencyTests-2014402934 None] Acquiring lock "cinder-quobyte-7c890b47-6f55-4825-8985-b7e141191093" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fd0ded75-9d58-4aed-bca4-a4ce3ae7f32d tempest-SnapshotDependencyTests-2014402934 None] Lock "cinder-quobyte-7c890b47-6f55-4825-8985-b7e141191093" acquired by "delete_volume" :: waited 0.014s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:36 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ea2356-d2f8-4c54-a480-8b1374e78433]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd0ded75-9d58-4aed-bca4-a4ce3ae7f32d tempest-SnapshotDependencyTests-2014402934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:36 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9f4c71ff-a6f0-48ba-9b43-015d27721ded tempest-VolumesActionsTest-1606486945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b" returned: 0 in 0.534s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:36 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-9f4c71ff-a6f0-48ba-9b43-015d27721ded tempest-VolumesActionsTest-1606486945 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b, size 1024.00 MB, duration 4.08 sec, destination /opt/stack/data/cinder/conversion/5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b.temp_image.7ee6cee0-be22-468b-9e92-86e176ddabc9pxnwqsbr.img {{(pid=87128) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:12:36 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-9f4c71ff-a6f0-48ba-9b43-015d27721ded tempest-VolumesActionsTest-1606486945 None] Converted 1024.00 MB image at 251.04 MB/s Sep 01 02:12:36 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-9f4c71ff-a6f0-48ba-9b43-015d27721ded tempest-VolumesActionsTest-1606486945 None] 7ee6cee0-be22-468b-9e92-86e176ddabc9 was raw, converting to qcow2 {{(pid=87128) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 01 02:12:36 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[909fd18b-c8f2-4df1-ac6f-d5f552c9a419]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9f4c71ff-a6f0-48ba-9b43-015d27721ded tempest-VolumesActionsTest-1606486945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b.temp_image.7ee6cee0-be22-468b-9e92-86e176ddabc9pxnwqsbr.img {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:36 devstack sudo[103124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093 Sep 01 02:12:36 devstack sudo[103124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:36 devstack sudo[103125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b.temp_image.7ee6cee0-be22-468b-9e92-86e176ddabc9pxnwqsbr.img Sep 01 02:12:36 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:36 devstack sudo[103124]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd0ded75-9d58-4aed-bca4-a4ce3ae7f32d tempest-SnapshotDependencyTests-2014402934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093" returned: 0 in 0.381s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd0ded75-9d58-4aed-bca4-a4ce3ae7f32d tempest-SnapshotDependencyTests-2014402934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:36 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093 Sep 01 02:12:36 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:36 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9f4c71ff-a6f0-48ba-9b43-015d27721ded tempest-VolumesActionsTest-1606486945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b.temp_image.7ee6cee0-be22-468b-9e92-86e176ddabc9pxnwqsbr.img" returned: 0 in 0.340s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9f4c71ff-a6f0-48ba-9b43-015d27721ded tempest-VolumesActionsTest-1606486945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b.temp_image.7ee6cee0-be22-468b-9e92-86e176ddabc9pxnwqsbr.img {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:36 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b.temp_image.7ee6cee0-be22-468b-9e92-86e176ddabc9pxnwqsbr.img Sep 01 02:12:36 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:37 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd0ded75-9d58-4aed-bca4-a4ce3ae7f32d tempest-SnapshotDependencyTests-2014402934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7c890b47-6f55-4825-8985-b7e141191093" returned: 0 in 0.269s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:37 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fd0ded75-9d58-4aed-bca4-a4ce3ae7f32d tempest-SnapshotDependencyTests-2014402934 None] Lock "cinder-quobyte-7c890b47-6f55-4825-8985-b7e141191093" released by "delete_volume" :: held 0.715s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:37 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-fd0ded75-9d58-4aed-bca4-a4ce3ae7f32d tempest-SnapshotDependencyTests-2014402934 None] Created reservations ['91042e26-3c8e-416a-ba3f-37d3e1f3515d', '1829091d-162b-4243-91a6-062b8e220fbd', '86657f97-fa78-4706-943b-a4ad81f3d516', '48a8b05e-d523-4e12-bbdb-5b4fdbe1a361'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:37 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9f4c71ff-a6f0-48ba-9b43-015d27721ded tempest-VolumesActionsTest-1606486945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b.temp_image.7ee6cee0-be22-468b-9e92-86e176ddabc9pxnwqsbr.img" returned: 1 in 0.381s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9f4c71ff-a6f0-48ba-9b43-015d27721ded tempest-VolumesActionsTest-1606486945 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b.temp_image.7ee6cee0-be22-468b-9e92-86e176ddabc9pxnwqsbr.img' failed. Not Retrying. {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:12:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9f4c71ff-a6f0-48ba-9b43-015d27721ded tempest-VolumesActionsTest-1606486945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b.temp_image.7ee6cee0-be22-468b-9e92-86e176ddabc9pxnwqsbr.img /opt/stack/data/cinder/conversion/vol_upload_it_tggq4 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:37 devstack sudo[103142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b.temp_image.7ee6cee0-be22-468b-9e92-86e176ddabc9pxnwqsbr.img /opt/stack/data/cinder/conversion/vol_upload_it_tggq4 Sep 01 02:12:37 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fd0ded75-9d58-4aed-bca4-a4ce3ae7f32d tempest-SnapshotDependencyTests-2014402934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fd0ded75-9d58-4aed-bca4-a4ce3ae7f32d tempest-SnapshotDependencyTests-2014402934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:37 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fd0ded75-9d58-4aed-bca4-a4ce3ae7f32d tempest-SnapshotDependencyTests-2014402934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:37 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fd0ded75-9d58-4aed-bca4-a4ce3ae7f32d tempest-SnapshotDependencyTests-2014402934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fd0ded75-9d58-4aed-bca4-a4ce3ae7f32d tempest-SnapshotDependencyTests-2014402934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd0ded75-9d58-4aed-bca4-a4ce3ae7f32d tempest-SnapshotDependencyTests-2014402934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:37 devstack sudo[103144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:12:37 devstack sudo[103144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:37 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-af30a9e4-4a3f-45ec-89e8-3a54231547ca tempest-SnapshotDependencyTests-2014402934 None] Acquiring lock "cinder-c5186d04-9b5f-47df-843f-5e94e9561585-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:37 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-af30a9e4-4a3f-45ec-89e8-3a54231547ca tempest-SnapshotDependencyTests-2014402934 None] Lock "cinder-c5186d04-9b5f-47df-843f-5e94e9561585-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:37 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9f4c71ff-a6f0-48ba-9b43-015d27721ded tempest-VolumesActionsTest-1606486945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b.temp_image.7ee6cee0-be22-468b-9e92-86e176ddabc9pxnwqsbr.img /opt/stack/data/cinder/conversion/vol_upload_it_tggq4" returned: 0 in 0.310s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:37 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-9f4c71ff-a6f0-48ba-9b43-015d27721ded tempest-VolumesActionsTest-1606486945 None] Image conversion details: src /opt/stack/data/cinder/conversion/5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b.temp_image.7ee6cee0-be22-468b-9e92-86e176ddabc9pxnwqsbr.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_it_tggq4 {{(pid=87128) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:12:37 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-9f4c71ff-a6f0-48ba-9b43-015d27721ded tempest-VolumesActionsTest-1606486945 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 01 02:12:37 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[253ce6e7-471f-487f-956e-3db801141cb7]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9f4c71ff-a6f0-48ba-9b43-015d27721ded tempest-VolumesActionsTest-1606486945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_it_tggq4 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:37 devstack sudo[103144]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd0ded75-9d58-4aed-bca4-a4ce3ae7f32d tempest-SnapshotDependencyTests-2014402934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.290s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:37 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-fd0ded75-9d58-4aed-bca4-a4ce3ae7f32d tempest-SnapshotDependencyTests-2014402934 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:37 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-fd0ded75-9d58-4aed-bca4-a4ce3ae7f32d tempest-SnapshotDependencyTests-2014402934 None] Deleted volume successfully. Sep 01 02:12:37 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-af30a9e4-4a3f-45ec-89e8-3a54231547ca tempest-SnapshotDependencyTests-2014402934 None] Acquiring lock "cinder-quobyte-c5186d04-9b5f-47df-843f-5e94e9561585" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:37 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-af30a9e4-4a3f-45ec-89e8-3a54231547ca tempest-SnapshotDependencyTests-2014402934 None] Lock "cinder-quobyte-c5186d04-9b5f-47df-843f-5e94e9561585" acquired by "delete_volume" :: waited 0.018s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:37 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fd0ded75-9d58-4aed-bca4-a4ce3ae7f32d tempest-SnapshotDependencyTests-2014402934 None] Lock "cinder-7c890b47-6f55-4825-8985-b7e141191093-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:37 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[409b6b29-ddb2-4105-bfc5-ca38bc1e5e2f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af30a9e4-4a3f-45ec-89e8-3a54231547ca tempest-SnapshotDependencyTests-2014402934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c5186d04-9b5f-47df-843f-5e94e9561585 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:37 devstack sudo[103151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_it_tggq4 Sep 01 02:12:37 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:37 devstack sudo[103152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c5186d04-9b5f-47df-843f-5e94e9561585 Sep 01 02:12:37 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:37 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9f4c71ff-a6f0-48ba-9b43-015d27721ded tempest-VolumesActionsTest-1606486945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_it_tggq4" returned: 0 in 0.362s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:37 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af30a9e4-4a3f-45ec-89e8-3a54231547ca tempest-SnapshotDependencyTests-2014402934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c5186d04-9b5f-47df-843f-5e94e9561585" returned: 0 in 0.369s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af30a9e4-4a3f-45ec-89e8-3a54231547ca tempest-SnapshotDependencyTests-2014402934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c5186d04-9b5f-47df-843f-5e94e9561585 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:38 devstack sudo[103161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c5186d04-9b5f-47df-843f-5e94e9561585 Sep 01 02:12:38 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:38 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af30a9e4-4a3f-45ec-89e8-3a54231547ca tempest-SnapshotDependencyTests-2014402934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c5186d04-9b5f-47df-843f-5e94e9561585" returned: 0 in 0.252s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:38 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-af30a9e4-4a3f-45ec-89e8-3a54231547ca tempest-SnapshotDependencyTests-2014402934 None] Lock "cinder-quobyte-c5186d04-9b5f-47df-843f-5e94e9561585" released by "delete_volume" :: held 0.666s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:38 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-af30a9e4-4a3f-45ec-89e8-3a54231547ca tempest-SnapshotDependencyTests-2014402934 None] Created reservations ['eeb3c1b0-8563-4f46-9078-b83e264eced4', '1b414327-2852-4f25-879f-1fa996119460', '07a1723b-6115-43cc-8854-831b3ea70f50', '10c0b206-3e20-483b-8903-9365d6708061'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-af30a9e4-4a3f-45ec-89e8-3a54231547ca tempest-SnapshotDependencyTests-2014402934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-af30a9e4-4a3f-45ec-89e8-3a54231547ca tempest-SnapshotDependencyTests-2014402934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:38 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-af30a9e4-4a3f-45ec-89e8-3a54231547ca tempest-SnapshotDependencyTests-2014402934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:38 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-af30a9e4-4a3f-45ec-89e8-3a54231547ca tempest-SnapshotDependencyTests-2014402934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-af30a9e4-4a3f-45ec-89e8-3a54231547ca tempest-SnapshotDependencyTests-2014402934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af30a9e4-4a3f-45ec-89e8-3a54231547ca tempest-SnapshotDependencyTests-2014402934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:38 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:12:38 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:38 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-af30a9e4-4a3f-45ec-89e8-3a54231547ca tempest-SnapshotDependencyTests-2014402934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.279s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:38 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-af30a9e4-4a3f-45ec-89e8-3a54231547ca tempest-SnapshotDependencyTests-2014402934 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:38 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-af30a9e4-4a3f-45ec-89e8-3a54231547ca tempest-SnapshotDependencyTests-2014402934 None] Deleted volume successfully. Sep 01 02:12:38 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-af30a9e4-4a3f-45ec-89e8-3a54231547ca tempest-SnapshotDependencyTests-2014402934 None] Lock "cinder-c5186d04-9b5f-47df-843f-5e94e9561585-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9f4c71ff-a6f0-48ba-9b43-015d27721ded tempest-VolumesActionsTest-1606486945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.434s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:39 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-9f4c71ff-a6f0-48ba-9b43-015d27721ded tempest-VolumesActionsTest-1606486945 None] Uploaded volume to glance image-id: 7ee6cee0-be22-468b-9e92-86e176ddabc9. {{(pid=87128) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 02:12:39 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-9f4c71ff-a6f0-48ba-9b43-015d27721ded tempest-VolumesActionsTest-1606486945 None] Copy volume to image completed successfully. Sep 01 02:12:40 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-54bad9e3-a8c0-4e81-9c80-d16e797c6974 tempest-VolumesActionsTest-1606486945 None] Acquiring lock "cinder-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:40 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-54bad9e3-a8c0-4e81-9c80-d16e797c6974 tempest-VolumesActionsTest-1606486945 None] Lock "cinder-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:40 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-54bad9e3-a8c0-4e81-9c80-d16e797c6974 tempest-VolumesActionsTest-1606486945 None] Acquiring lock "cinder-quobyte-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:40 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-54bad9e3-a8c0-4e81-9c80-d16e797c6974 tempest-VolumesActionsTest-1606486945 None] Lock "cinder-quobyte-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b" acquired by "delete_volume" :: waited 0.015s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:40 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bde1579-815e-470c-96f7-006b3543a209]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-54bad9e3-a8c0-4e81-9c80-d16e797c6974 tempest-VolumesActionsTest-1606486945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:40 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b Sep 01 02:12:40 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:40 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-54bad9e3-a8c0-4e81-9c80-d16e797c6974 tempest-VolumesActionsTest-1606486945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b" returned: 0 in 0.381s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-54bad9e3-a8c0-4e81-9c80-d16e797c6974 tempest-VolumesActionsTest-1606486945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:41 devstack sudo[103175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b Sep 01 02:12:41 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:41 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-54bad9e3-a8c0-4e81-9c80-d16e797c6974 tempest-VolumesActionsTest-1606486945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b" returned: 0 in 0.251s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:41 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-54bad9e3-a8c0-4e81-9c80-d16e797c6974 tempest-VolumesActionsTest-1606486945 None] Lock "cinder-quobyte-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b" released by "delete_volume" :: held 0.675s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:41 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-54bad9e3-a8c0-4e81-9c80-d16e797c6974 tempest-VolumesActionsTest-1606486945 None] Created reservations ['42f1c65b-ce1f-4d0a-b543-bad55a6c2793', '4d9171d9-57ea-4d5c-80aa-37162ea2bf7b', 'e89c0eff-9cc0-4ccf-8304-809c0ee94d42', '8ffefc0d-baa6-4385-be62-44802439bfc5'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-54bad9e3-a8c0-4e81-9c80-d16e797c6974 tempest-VolumesActionsTest-1606486945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-54bad9e3-a8c0-4e81-9c80-d16e797c6974 tempest-VolumesActionsTest-1606486945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-54bad9e3-a8c0-4e81-9c80-d16e797c6974 tempest-VolumesActionsTest-1606486945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-54bad9e3-a8c0-4e81-9c80-d16e797c6974 tempest-VolumesActionsTest-1606486945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-54bad9e3-a8c0-4e81-9c80-d16e797c6974 tempest-VolumesActionsTest-1606486945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-54bad9e3-a8c0-4e81-9c80-d16e797c6974 tempest-VolumesActionsTest-1606486945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:41 devstack sudo[103178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:12:41 devstack sudo[103178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:41 devstack sudo[103178]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-54bad9e3-a8c0-4e81-9c80-d16e797c6974 tempest-VolumesActionsTest-1606486945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.300s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:41 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-54bad9e3-a8c0-4e81-9c80-d16e797c6974 tempest-VolumesActionsTest-1606486945 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:41 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-54bad9e3-a8c0-4e81-9c80-d16e797c6974 tempest-VolumesActionsTest-1606486945 None] Deleted volume successfully. Sep 01 02:12:41 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-54bad9e3-a8c0-4e81-9c80-d16e797c6974 tempest-VolumesActionsTest-1606486945 None] Lock "cinder-5bb382ab-15aa-4a9a-9ad4-7f5784b4fb6b-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:49 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] Flow 'volume_create_manager' (531ad073-e456-4f9c-bac8-b39bbf9c44d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (721eef1e-f5a3-4666-ab3b-fb1bd8349ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (721eef1e-f5a3-4666-ab3b-fb1bd8349ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2014997920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=598c932f-eb9b-425e-91f0-f4715070754f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e62059e09c71448da8cb5841eb99ec1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:50Z,use_quota=True,user_id='ea5084b1054148f9b6d0ac126ea43844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9d916a3-00ec-4437-bd41-667ded236355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9d916a3-00ec-4437-bd41-667ded236355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af556034-869c-41df-9711-a3c4fbe8d336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af556034-869c-41df-9711-a3c4fbe8d336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '598c932f-eb9b-425e-91f0-f4715070754f', 'volume_name': 'volume-598c932f-eb9b-425e-91f0-f4715070754f', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:50 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7765fb2f-4c6a-4887-b01c-9ee5f9a3a76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:50 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7765fb2f-4c6a-4887-b01c-9ee5f9a3a76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:50 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a035e1f-dbf9-47b9-9655-00fb6b0657d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:50 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] Volume 598c932f-eb9b-425e-91f0-f4715070754f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-598c932f-eb9b-425e-91f0-f4715070754f', 'volume_size': 1} Sep 01 02:12:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:50 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2014997920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=598c932f-eb9b-425e-91f0-f4715070754f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e62059e09c71448da8cb5841eb99ec1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:50Z,use_quota=True,user_id='ea5084b1054148f9b6d0ac126ea43844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:50 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] Creating volume 598c932f-eb9b-425e-91f0-f4715070754f {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:50 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:50 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:50 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:50 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:12:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:50 devstack sudo[103189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f 1073741824 Sep 01 02:12:50 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:50 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f 1073741824" returned: 0 in 0.482s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:50 devstack sudo[103194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f Sep 01 02:12:50 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:50 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f" returned: 0 in 0.259s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:50 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:50 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a035e1f-dbf9-47b9-9655-00fb6b0657d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-598c932f-eb9b-425e-91f0-f4715070754f', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:50 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe12bbc0-7ecd-4f12-81e5-8134948da5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:50 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] Volume volume-598c932f-eb9b-425e-91f0-f4715070754f (598c932f-eb9b-425e-91f0-f4715070754f): created successfully Sep 01 02:12:50 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe12bbc0-7ecd-4f12-81e5-8134948da5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:50 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] Flow 'volume_create_manager' (531ad073-e456-4f9c-bac8-b39bbf9c44d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:50 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-701964f2-204e-410a-8949-593789db6e3c tempest-VolumesCloneTest-636843803 None] Created volume successfully. Sep 01 02:12:52 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Flow 'volume_create_manager' (a69799ef-0a83-49b0-9bf5-69ca5b4371d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf534631-aebe-46e2-90f5-20882f1ad395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf534631-aebe-46e2-90f5-20882f1ad395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1926950664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a87bc7f9-6775-4da6-8deb-298c997ba1ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e62059e09c71448da8cb5841eb99ec1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=598c932f-eb9b-425e-91f0-f4715070754f,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:52Z,use_quota=True,user_id='ea5084b1054148f9b6d0ac126ea43844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b395ff74-45af-496c-a726-0d7f578dc6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b395ff74-45af-496c-a726-0d7f578dc6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8bf87a6-c621-4c08-84b7-a20035803086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8bf87a6-c621-4c08-84b7-a20035803086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a87bc7f9-6775-4da6-8deb-298c997ba1ea', 'volume_name': 'volume-a87bc7f9-6775-4da6-8deb-298c997ba1ea', 'volume_size': 2, 'source_volid': '598c932f-eb9b-425e-91f0-f4715070754f', 'source_volstatus': 'available'}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347ad6cd-8b09-4cb4-a255-325135455eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347ad6cd-8b09-4cb4-a255-325135455eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf9bc4f-56b4-4d49-bcce-d56be94ad6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:52 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Volume a87bc7f9-6775-4da6-8deb-298c997ba1ea: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a87bc7f9-6775-4da6-8deb-298c997ba1ea', 'volume_size': 2, 'source_volid': '598c932f-eb9b-425e-91f0-f4715070754f', 'source_volstatus': 'available'} Sep 01 02:12:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:52 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Cloning volume 598c932f-eb9b-425e-91f0-f4715070754f to volume a87bc7f9-6775-4da6-8deb-298c997ba1ea Sep 01 02:12:52 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Creating offline snapshot 2e9f873a-c63e-41fd-af87-c94856ece783 of volume 598c932f-eb9b-425e-91f0-f4715070754f {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:12:52 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15f1c27-2f86-41df-8104-a9ed8a9cfc3a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:52 devstack sudo[103198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f Sep 01 02:12:52 devstack sudo[103198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:52 devstack sudo[103198]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f" returned: 0 in 0.348s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f.2e9f873a-c63e-41fd-af87-c94856ece783 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:52 devstack sudo[103203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f.2e9f873a-c63e-41fd-af87-c94856ece783 1G Sep 01 02:12:52 devstack sudo[103203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:53 devstack sudo[103203]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f.2e9f873a-c63e-41fd-af87-c94856ece783 1G" returned: 0 in 0.382s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-598c932f-eb9b-425e-91f0-f4715070754f -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f.2e9f873a-c63e-41fd-af87-c94856ece783 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:53 devstack sudo[103209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-598c932f-eb9b-425e-91f0-f4715070754f -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f.2e9f873a-c63e-41fd-af87-c94856ece783 Sep 01 02:12:53 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:53 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-598c932f-eb9b-425e-91f0-f4715070754f -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f.2e9f873a-c63e-41fd-af87-c94856ece783" returned: 0 in 0.280s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:53 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f.2e9f873a-c63e-41fd-af87-c94856ece783 is being set with open permissions: ugo+rw Sep 01 02:12:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f.2e9f873a-c63e-41fd-af87-c94856ece783 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:53 devstack sudo[103214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f.2e9f873a-c63e-41fd-af87-c94856ece783 Sep 01 02:12:53 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:53 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f.2e9f873a-c63e-41fd-af87-c94856ece783" returned: 0 in 0.238s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:53 devstack sudo[103217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f.info Sep 01 02:12:53 devstack sudo[103217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:54 devstack sudo[103217]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f.info" returned: 0 in 0.241s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:54 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f.info is being set with open permissions: ugo+rw Sep 01 02:12:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:54 devstack sudo[103220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f.info Sep 01 02:12:54 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:54 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f.info" returned: 0 in 0.242s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:54 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Acquiring lock "cinder-quobyte-a87bc7f9-6775-4da6-8deb-298c997ba1ea" by "_copy_volume_from_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:54 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Lock "cinder-quobyte-a87bc7f9-6775-4da6-8deb-298c997ba1ea" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] snapshot: 2e9f873a-c63e-41fd-af87-c94856ece783, volume: a87bc7f9-6775-4da6-8deb-298c997ba1ea, {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:12:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:54 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b8eaa2-97b4-43e7-9b4e-a2d815cf6dd1]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f.2e9f873a-c63e-41fd-af87-c94856ece783 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:54 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f.2e9f873a-c63e-41fd-af87-c94856ece783 Sep 01 02:12:54 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:54 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f.2e9f873a-c63e-41fd-af87-c94856ece783" returned: 0 in 0.348s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-598c932f-eb9b-425e-91f0-f4715070754f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:54 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af7c4d6-57a7-456a-826f-05fe49deabb7]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:54 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f Sep 01 02:12:54 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:55 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f" returned: 0 in 0.347s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:55 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:12:55 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Creating direct copy from snapshot {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:12:55 devstack cinder-volume[87128]: DEBUG cinder.utils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Path /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a87bc7f9-6775-4da6-8deb-298c997ba1ea not found in is_blk_device check {{(pid=87128) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:12:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a87bc7f9-6775-4da6-8deb-298c997ba1ea {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:55 devstack sudo[103234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a87bc7f9-6775-4da6-8deb-298c997ba1ea Sep 01 02:12:55 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:59 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a87bc7f9-6775-4da6-8deb-298c997ba1ea" returned: 0 in 3.992s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:59 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f, size 1024.00 MB, duration 3.99 sec, destination /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a87bc7f9-6775-4da6-8deb-298c997ba1ea {{(pid=87128) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:12:59 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Converted 1024.00 MB image at 256.42 MB/s Sep 01 02:12:59 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a87bc7f9-6775-4da6-8deb-298c997ba1ea is being set with open permissions: ugo+rw Sep 01 02:12:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a87bc7f9-6775-4da6-8deb-298c997ba1ea {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:59 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a87bc7f9-6775-4da6-8deb-298c997ba1ea Sep 01 02:12:59 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:59 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a87bc7f9-6775-4da6-8deb-298c997ba1ea" returned: 0 in 0.299s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:59 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Lock "cinder-quobyte-a87bc7f9-6775-4da6-8deb-298c997ba1ea" released by "_copy_volume_from_snapshot" :: held 5.055s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:59 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Acquiring lock "cinder-quobyte-2e9f873a-c63e-41fd-af87-c94856ece783" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:59 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Lock "cinder-quobyte-2e9f873a-c63e-41fd-af87-c94856ece783" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:59 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Deleting offline snapshot 2e9f873a-c63e-41fd-af87-c94856ece783 of volume 598c932f-eb9b-425e-91f0-f4715070754f {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:12:59 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] snapshot_file for this snap is: volume-598c932f-eb9b-425e-91f0-f4715070754f.2e9f873a-c63e-41fd-af87-c94856ece783 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:12:59 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[59959250-8cc4-405b-976d-3118f9fd51e7]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f.2e9f873a-c63e-41fd-af87-c94856ece783 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:59 devstack sudo[103251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f.2e9f873a-c63e-41fd-af87-c94856ece783 Sep 01 02:12:59 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:59 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f.2e9f873a-c63e-41fd-af87-c94856ece783" returned: 0 in 0.349s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:59 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-598c932f-eb9b-425e-91f0-f4715070754f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:59 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[607a91e4-eef8-40b6-998f-659eb266e9ef]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:00 devstack sudo[103256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f Sep 01 02:13:00 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:00 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f" returned: 0 in 0.561s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f.2e9f873a-c63e-41fd-af87-c94856ece783 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:00 devstack sudo[103261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f.2e9f873a-c63e-41fd-af87-c94856ece783 Sep 01 02:13:00 devstack sudo[103261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:00 devstack sudo[103261]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f.2e9f873a-c63e-41fd-af87-c94856ece783" returned: 0 in 0.358s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f.2e9f873a-c63e-41fd-af87-c94856ece783 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:00 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f.2e9f873a-c63e-41fd-af87-c94856ece783 Sep 01 02:13:00 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:01 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f.2e9f873a-c63e-41fd-af87-c94856ece783" returned: 0 in 0.281s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:01 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Lock "cinder-quobyte-2e9f873a-c63e-41fd-af87-c94856ece783" released by "_delete_snapshot" :: held 1.637s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.628s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf9bc4f-56b4-4d49-bcce-d56be94ad6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a87bc7f9-6775-4da6-8deb-298c997ba1ea', 'volume_size': 2, 'source_volid': '598c932f-eb9b-425e-91f0-f4715070754f', 'source_volstatus': 'available'}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae808f28-1bb5-4017-9b02-8eba5b664a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:01 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Volume volume-a87bc7f9-6775-4da6-8deb-298c997ba1ea (a87bc7f9-6775-4da6-8deb-298c997ba1ea): created successfully Sep 01 02:13:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae808f28-1bb5-4017-9b02-8eba5b664a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Flow 'volume_create_manager' (a69799ef-0a83-49b0-9bf5-69ca5b4371d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:01 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-38f0cc29-105c-419d-a042-969185598809 tempest-VolumesCloneTest-636843803 None] Created volume successfully. Sep 01 02:13:02 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2de24937-3441-4949-908f-e0320532cd79 tempest-VolumesCloneTest-636843803 None] Acquiring lock "cinder-a87bc7f9-6775-4da6-8deb-298c997ba1ea-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:02 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2de24937-3441-4949-908f-e0320532cd79 tempest-VolumesCloneTest-636843803 None] Lock "cinder-a87bc7f9-6775-4da6-8deb-298c997ba1ea-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:02 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2de24937-3441-4949-908f-e0320532cd79 tempest-VolumesCloneTest-636843803 None] Acquiring lock "cinder-quobyte-a87bc7f9-6775-4da6-8deb-298c997ba1ea" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:02 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2de24937-3441-4949-908f-e0320532cd79 tempest-VolumesCloneTest-636843803 None] Lock "cinder-quobyte-a87bc7f9-6775-4da6-8deb-298c997ba1ea" acquired by "delete_volume" :: waited 0.013s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:02 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b99430-ae9e-41ed-81dc-44bd025d1ed5]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2de24937-3441-4949-908f-e0320532cd79 tempest-VolumesCloneTest-636843803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a87bc7f9-6775-4da6-8deb-298c997ba1ea {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:02 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a87bc7f9-6775-4da6-8deb-298c997ba1ea Sep 01 02:13:02 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:02 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2de24937-3441-4949-908f-e0320532cd79 tempest-VolumesCloneTest-636843803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a87bc7f9-6775-4da6-8deb-298c997ba1ea" returned: 0 in 0.350s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2de24937-3441-4949-908f-e0320532cd79 tempest-VolumesCloneTest-636843803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a87bc7f9-6775-4da6-8deb-298c997ba1ea {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:02 devstack sudo[103275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a87bc7f9-6775-4da6-8deb-298c997ba1ea Sep 01 02:13:02 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:03 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2de24937-3441-4949-908f-e0320532cd79 tempest-VolumesCloneTest-636843803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a87bc7f9-6775-4da6-8deb-298c997ba1ea" returned: 0 in 0.258s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:03 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2de24937-3441-4949-908f-e0320532cd79 tempest-VolumesCloneTest-636843803 None] Lock "cinder-quobyte-a87bc7f9-6775-4da6-8deb-298c997ba1ea" released by "delete_volume" :: held 0.649s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:03 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-2de24937-3441-4949-908f-e0320532cd79 tempest-VolumesCloneTest-636843803 None] Created reservations ['1ee5bc0f-f9ac-40bd-82e1-d8d9e9d1b896', '05d63bf0-5dbd-4d5d-82bb-36352a587d6f', '181ab352-6da3-44c9-bf74-0862c63aeed8', '6398b1df-474c-4ae5-9871-8eca7a26cd8d'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2de24937-3441-4949-908f-e0320532cd79 tempest-VolumesCloneTest-636843803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2de24937-3441-4949-908f-e0320532cd79 tempest-VolumesCloneTest-636843803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:03 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2de24937-3441-4949-908f-e0320532cd79 tempest-VolumesCloneTest-636843803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:03 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2de24937-3441-4949-908f-e0320532cd79 tempest-VolumesCloneTest-636843803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2de24937-3441-4949-908f-e0320532cd79 tempest-VolumesCloneTest-636843803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2de24937-3441-4949-908f-e0320532cd79 tempest-VolumesCloneTest-636843803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:03 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:13:03 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:03 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2de24937-3441-4949-908f-e0320532cd79 tempest-VolumesCloneTest-636843803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.245s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:03 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-2de24937-3441-4949-908f-e0320532cd79 tempest-VolumesCloneTest-636843803 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:03 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-2de24937-3441-4949-908f-e0320532cd79 tempest-VolumesCloneTest-636843803 None] Deleted volume successfully. Sep 01 02:13:03 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2de24937-3441-4949-908f-e0320532cd79 tempest-VolumesCloneTest-636843803 None] Lock "cinder-a87bc7f9-6775-4da6-8deb-298c997ba1ea-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:03 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-986b2eb5-8eb4-425f-8793-fdc1d49cafb6 tempest-VolumesCloneTest-636843803 None] Acquiring lock "cinder-598c932f-eb9b-425e-91f0-f4715070754f-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:03 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-986b2eb5-8eb4-425f-8793-fdc1d49cafb6 tempest-VolumesCloneTest-636843803 None] Lock "cinder-598c932f-eb9b-425e-91f0-f4715070754f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:03 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-986b2eb5-8eb4-425f-8793-fdc1d49cafb6 tempest-VolumesCloneTest-636843803 None] Acquiring lock "cinder-quobyte-598c932f-eb9b-425e-91f0-f4715070754f" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:03 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-986b2eb5-8eb4-425f-8793-fdc1d49cafb6 tempest-VolumesCloneTest-636843803 None] Lock "cinder-quobyte-598c932f-eb9b-425e-91f0-f4715070754f" acquired by "delete_volume" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:03 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a41d4a-e53e-4265-bb2f-cd8cc77b2a42]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-986b2eb5-8eb4-425f-8793-fdc1d49cafb6 tempest-VolumesCloneTest-636843803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:03 devstack sudo[103281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f Sep 01 02:13:03 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:04 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-986b2eb5-8eb4-425f-8793-fdc1d49cafb6 tempest-VolumesCloneTest-636843803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f" returned: 0 in 0.352s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-986b2eb5-8eb4-425f-8793-fdc1d49cafb6 tempest-VolumesCloneTest-636843803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:04 devstack sudo[103286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f Sep 01 02:13:04 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:04 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-986b2eb5-8eb4-425f-8793-fdc1d49cafb6 tempest-VolumesCloneTest-636843803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-598c932f-eb9b-425e-91f0-f4715070754f" returned: 0 in 0.274s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:04 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-986b2eb5-8eb4-425f-8793-fdc1d49cafb6 tempest-VolumesCloneTest-636843803 None] Lock "cinder-quobyte-598c932f-eb9b-425e-91f0-f4715070754f" released by "delete_volume" :: held 0.679s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:04 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-986b2eb5-8eb4-425f-8793-fdc1d49cafb6 tempest-VolumesCloneTest-636843803 None] Created reservations ['baf68203-37ce-4cb9-9448-b180009cfacc', '30b719df-d0af-4915-9a29-9d8e2c84f901', 'a8cb041b-aee7-46d4-a2f0-2dd235954b24', '1fd0463a-9db6-4e14-a066-7c65c65ca3a9'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-986b2eb5-8eb4-425f-8793-fdc1d49cafb6 tempest-VolumesCloneTest-636843803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-986b2eb5-8eb4-425f-8793-fdc1d49cafb6 tempest-VolumesCloneTest-636843803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:04 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-986b2eb5-8eb4-425f-8793-fdc1d49cafb6 tempest-VolumesCloneTest-636843803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:04 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-986b2eb5-8eb4-425f-8793-fdc1d49cafb6 tempest-VolumesCloneTest-636843803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-986b2eb5-8eb4-425f-8793-fdc1d49cafb6 tempest-VolumesCloneTest-636843803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-986b2eb5-8eb4-425f-8793-fdc1d49cafb6 tempest-VolumesCloneTest-636843803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:04 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:13:04 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:04 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-986b2eb5-8eb4-425f-8793-fdc1d49cafb6 tempest-VolumesCloneTest-636843803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.255s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:04 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-986b2eb5-8eb4-425f-8793-fdc1d49cafb6 tempest-VolumesCloneTest-636843803 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:04 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-986b2eb5-8eb4-425f-8793-fdc1d49cafb6 tempest-VolumesCloneTest-636843803 None] Deleted volume successfully. Sep 01 02:13:04 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-986b2eb5-8eb4-425f-8793-fdc1d49cafb6 tempest-VolumesCloneTest-636843803 None] Lock "cinder-598c932f-eb9b-425e-91f0-f4715070754f-delete_volume" released by "delete_volume" :: held 1.122s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:07 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] Flow 'volume_create_manager' (80c49dca-aed8-46c6-99a2-c41028e5eba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94516427-769f-47e6-9b08-006127da1ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94516427-769f-47e6-9b08-006127da1ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1808940181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb824ffb-9c6c-4846-b459-9b620c73c017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e43703fa97949c3a6ee49d5c70849c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:08Z,use_quota=True,user_id='82d0f9abfc6c43f1b0bee4cb7601de47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a86e00e1-69fe-4096-947c-aaff0b783204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a86e00e1-69fe-4096-947c-aaff0b783204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ba48ce-3d62-4e29-8615-b9bf2ba3e5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ba48ce-3d62-4e29-8615-b9bf2ba3e5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb824ffb-9c6c-4846-b459-9b620c73c017', 'volume_name': 'volume-cb824ffb-9c6c-4846-b459-9b620c73c017', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d150279f-26b8-43ed-a673-37a4826dd183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d150279f-26b8-43ed-a673-37a4826dd183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87d4ce1-afac-4d50-8014-af874cbe81ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:07 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] Volume cb824ffb-9c6c-4846-b459-9b620c73c017: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb824ffb-9c6c-4846-b459-9b620c73c017', 'volume_size': 1} Sep 01 02:13:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:07 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1808940181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb824ffb-9c6c-4846-b459-9b620c73c017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e43703fa97949c3a6ee49d5c70849c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:08Z,use_quota=True,user_id='82d0f9abfc6c43f1b0bee4cb7601de47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:07 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] Creating volume cb824ffb-9c6c-4846-b459-9b620c73c017 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:07 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:07 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:07 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:07 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:13:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cb824ffb-9c6c-4846-b459-9b620c73c017 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:07 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cb824ffb-9c6c-4846-b459-9b620c73c017 1073741824 Sep 01 02:13:07 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:08 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cb824ffb-9c6c-4846-b459-9b620c73c017 1073741824" returned: 0 in 0.418s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cb824ffb-9c6c-4846-b459-9b620c73c017 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:08 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cb824ffb-9c6c-4846-b459-9b620c73c017 Sep 01 02:13:08 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:08 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cb824ffb-9c6c-4846-b459-9b620c73c017" returned: 0 in 0.236s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87d4ce1-afac-4d50-8014-af874cbe81ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb824ffb-9c6c-4846-b459-9b620c73c017', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3972ff17-20cc-4684-ba82-463d84c0eca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:08 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] Volume volume-cb824ffb-9c6c-4846-b459-9b620c73c017 (cb824ffb-9c6c-4846-b459-9b620c73c017): created successfully Sep 01 02:13:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3972ff17-20cc-4684-ba82-463d84c0eca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:08 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] Flow 'volume_create_manager' (80c49dca-aed8-46c6-99a2-c41028e5eba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:08 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-1520b339-1f6a-4e10-b954-8fef0c6b6d6c tempest-VolumesNegativeTest-1339912883 None] Created volume successfully. Sep 01 02:13:16 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:13:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:17 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:13:17 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:17 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.286s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:17 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:17 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager._thread_info {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:13:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread count: 29 {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:13:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread info: [<_MainThread(MainThread, started 128688016527488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:13:18 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:UPDATE=65,cinder:SELECT=44,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:13:18 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=45,cinder:UPDATE=55,cinder:DELETE=6,cinder:INSERT=19 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:13:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-76543490-5c25-42f4-9099-ca4bef89785c tempest-VolumesNegativeTest-1339912883 None] Acquiring lock "cinder-cb824ffb-9c6c-4846-b459-9b620c73c017-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-76543490-5c25-42f4-9099-ca4bef89785c tempest-VolumesNegativeTest-1339912883 None] Lock "cinder-cb824ffb-9c6c-4846-b459-9b620c73c017-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-76543490-5c25-42f4-9099-ca4bef89785c tempest-VolumesNegativeTest-1339912883 None] Acquiring lock "cinder-quobyte-cb824ffb-9c6c-4846-b459-9b620c73c017" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-76543490-5c25-42f4-9099-ca4bef89785c tempest-VolumesNegativeTest-1339912883 None] Lock "cinder-quobyte-cb824ffb-9c6c-4846-b459-9b620c73c017" acquired by "delete_volume" :: waited 0.014s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:24 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[8680f5a0-3d44-4232-b724-6fb28441a842]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-76543490-5c25-42f4-9099-ca4bef89785c tempest-VolumesNegativeTest-1339912883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cb824ffb-9c6c-4846-b459-9b620c73c017 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:24 devstack sudo[103418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cb824ffb-9c6c-4846-b459-9b620c73c017 Sep 01 02:13:24 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:24 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-76543490-5c25-42f4-9099-ca4bef89785c tempest-VolumesNegativeTest-1339912883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cb824ffb-9c6c-4846-b459-9b620c73c017" returned: 0 in 0.352s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-76543490-5c25-42f4-9099-ca4bef89785c tempest-VolumesNegativeTest-1339912883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cb824ffb-9c6c-4846-b459-9b620c73c017 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:24 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cb824ffb-9c6c-4846-b459-9b620c73c017 Sep 01 02:13:24 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:24 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-76543490-5c25-42f4-9099-ca4bef89785c tempest-VolumesNegativeTest-1339912883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cb824ffb-9c6c-4846-b459-9b620c73c017" returned: 0 in 0.238s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-76543490-5c25-42f4-9099-ca4bef89785c tempest-VolumesNegativeTest-1339912883 None] Lock "cinder-quobyte-cb824ffb-9c6c-4846-b459-9b620c73c017" released by "delete_volume" :: held 0.628s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:24 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-76543490-5c25-42f4-9099-ca4bef89785c tempest-VolumesNegativeTest-1339912883 None] Created reservations ['55835138-2e00-4612-95d5-8c62454951cb', '5753106d-fc2e-4f62-ba2c-2902f0f8ade4', '4a8bcb7e-2f84-4ae7-8b14-6099e526cd90', 'b291be61-1269-4fa2-8fa1-e3345a7db823'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-76543490-5c25-42f4-9099-ca4bef89785c tempest-VolumesNegativeTest-1339912883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-76543490-5c25-42f4-9099-ca4bef89785c tempest-VolumesNegativeTest-1339912883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:24 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-76543490-5c25-42f4-9099-ca4bef89785c tempest-VolumesNegativeTest-1339912883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:24 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-76543490-5c25-42f4-9099-ca4bef89785c tempest-VolumesNegativeTest-1339912883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-76543490-5c25-42f4-9099-ca4bef89785c tempest-VolumesNegativeTest-1339912883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-76543490-5c25-42f4-9099-ca4bef89785c tempest-VolumesNegativeTest-1339912883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:24 devstack sudo[103426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:13:24 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:25 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-76543490-5c25-42f4-9099-ca4bef89785c tempest-VolumesNegativeTest-1339912883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.226s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:25 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-76543490-5c25-42f4-9099-ca4bef89785c tempest-VolumesNegativeTest-1339912883 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:25 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-76543490-5c25-42f4-9099-ca4bef89785c tempest-VolumesNegativeTest-1339912883 None] Deleted volume successfully. Sep 01 02:13:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-76543490-5c25-42f4-9099-ca4bef89785c tempest-VolumesNegativeTest-1339912883 None] Lock "cinder-cb824ffb-9c6c-4846-b459-9b620c73c017-delete_volume" released by "delete_volume" :: held 1.038s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:34 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=6 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:13:35 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:UPDATE=10,cinder:SELECT=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] Flow 'volume_create_manager' (69ce0b32-3eed-4e4f-8d15-2b81891df87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81da6069-0575-49a2-af39-42444e99daea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81da6069-0575-49a2-af39-42444e99daea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1705461690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=377c0c4e-1745-4cc7-9fbc-efb951658103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd0e64f9ccde458f926eaa5ea24a0856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:37Z,use_quota=True,user_id='899fa30b2f484ca28d59ca322ed73d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (658eb82b-c4f5-482e-88a9-6eac3ae755d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (658eb82b-c4f5-482e-88a9-6eac3ae755d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d934e2d5-7f65-4070-94fd-6a5f76d1b9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d934e2d5-7f65-4070-94fd-6a5f76d1b9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '377c0c4e-1745-4cc7-9fbc-efb951658103', 'volume_name': 'volume-377c0c4e-1745-4cc7-9fbc-efb951658103', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e1cc5d6-ffea-4c3a-ade9-06de8f029111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e1cc5d6-ffea-4c3a-ade9-06de8f029111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a44eba1c-5976-454c-b87b-5d6c6e4dfb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:37 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] Volume 377c0c4e-1745-4cc7-9fbc-efb951658103: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-377c0c4e-1745-4cc7-9fbc-efb951658103', 'volume_size': 1} Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1705461690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=377c0c4e-1745-4cc7-9fbc-efb951658103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd0e64f9ccde458f926eaa5ea24a0856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:37Z,use_quota=True,user_id='899fa30b2f484ca28d59ca322ed73d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] Creating volume 377c0c4e-1745-4cc7-9fbc-efb951658103 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:37 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:37 devstack sudo[103474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103 1073741824 Sep 01 02:13:37 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:37 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103 1073741824" returned: 0 in 0.411s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:37 devstack sudo[103480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103 Sep 01 02:13:37 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:37 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103" returned: 0 in 0.230s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a44eba1c-5976-454c-b87b-5d6c6e4dfb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-377c0c4e-1745-4cc7-9fbc-efb951658103', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18a73b9-96f5-41e3-ad38-9eb224dcd762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:37 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] Volume volume-377c0c4e-1745-4cc7-9fbc-efb951658103 (377c0c4e-1745-4cc7-9fbc-efb951658103): created successfully Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18a73b9-96f5-41e3-ad38-9eb224dcd762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] Flow 'volume_create_manager' (69ce0b32-3eed-4e4f-8d15-2b81891df87e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:37 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-1524b90f-2d75-410d-919d-81b53e24e697 tempest-VolumesSnapshotTestJSON-631116841 None] Created volume successfully. Sep 01 02:13:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0a853587-ab8d-4a28-a5a8-147f8d44ad87 tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0a853587-ab8d-4a28-a5a8-147f8d44ad87 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:38 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-0a853587-ab8d-4a28-a5a8-147f8d44ad87 tempest-VolumesSnapshotTestJSON-631116841 None] Creating offline snapshot 3ecbd606-2efd-4b95-9d2d-8ab82eea51cd of volume 377c0c4e-1745-4cc7-9fbc-efb951658103 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:13:38 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79ab0a3-5cae-4f01-87ed-91c30d7daab4]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0a853587-ab8d-4a28-a5a8-147f8d44ad87 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:38 devstack sudo[103483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103 Sep 01 02:13:38 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:38 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0a853587-ab8d-4a28-a5a8-147f8d44ad87 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103" returned: 0 in 0.353s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0a853587-ab8d-4a28-a5a8-147f8d44ad87 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103.3ecbd606-2efd-4b95-9d2d-8ab82eea51cd 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:38 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103.3ecbd606-2efd-4b95-9d2d-8ab82eea51cd 1G Sep 01 02:13:38 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:39 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0a853587-ab8d-4a28-a5a8-147f8d44ad87 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103.3ecbd606-2efd-4b95-9d2d-8ab82eea51cd 1G" returned: 0 in 0.387s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0a853587-ab8d-4a28-a5a8-147f8d44ad87 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-377c0c4e-1745-4cc7-9fbc-efb951658103 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103.3ecbd606-2efd-4b95-9d2d-8ab82eea51cd {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:39 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-377c0c4e-1745-4cc7-9fbc-efb951658103 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103.3ecbd606-2efd-4b95-9d2d-8ab82eea51cd Sep 01 02:13:39 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:39 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0a853587-ab8d-4a28-a5a8-147f8d44ad87 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-377c0c4e-1745-4cc7-9fbc-efb951658103 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103.3ecbd606-2efd-4b95-9d2d-8ab82eea51cd" returned: 0 in 0.276s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:39 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-0a853587-ab8d-4a28-a5a8-147f8d44ad87 tempest-VolumesSnapshotTestJSON-631116841 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103.3ecbd606-2efd-4b95-9d2d-8ab82eea51cd is being set with open permissions: ugo+rw Sep 01 02:13:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0a853587-ab8d-4a28-a5a8-147f8d44ad87 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103.3ecbd606-2efd-4b95-9d2d-8ab82eea51cd {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:39 devstack sudo[103499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103.3ecbd606-2efd-4b95-9d2d-8ab82eea51cd Sep 01 02:13:39 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:39 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0a853587-ab8d-4a28-a5a8-147f8d44ad87 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103.3ecbd606-2efd-4b95-9d2d-8ab82eea51cd" returned: 0 in 0.230s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0a853587-ab8d-4a28-a5a8-147f8d44ad87 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:39 devstack sudo[103502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103.info Sep 01 02:13:39 devstack sudo[103502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:39 devstack sudo[103502]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0a853587-ab8d-4a28-a5a8-147f8d44ad87 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103.info" returned: 0 in 0.246s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:39 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-0a853587-ab8d-4a28-a5a8-147f8d44ad87 tempest-VolumesSnapshotTestJSON-631116841 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103.info is being set with open permissions: ugo+rw Sep 01 02:13:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0a853587-ab8d-4a28-a5a8-147f8d44ad87 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:39 devstack sudo[103505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103.info Sep 01 02:13:39 devstack sudo[103505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:40 devstack sudo[103505]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0a853587-ab8d-4a28-a5a8-147f8d44ad87 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103.info" returned: 0 in 0.246s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0a853587-ab8d-4a28-a5a8-147f8d44ad87 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.825s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:40 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-0a853587-ab8d-4a28-a5a8-147f8d44ad87 tempest-VolumesSnapshotTestJSON-631116841 None] Create snapshot completed successfully Sep 01 02:13:40 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-371d9cf4-1179-4bc8-813e-8d178713099d tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "cinder-3ecbd606-2efd-4b95-9d2d-8ab82eea51cd-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:40 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-371d9cf4-1179-4bc8-813e-8d178713099d tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-3ecbd606-2efd-4b95-9d2d-8ab82eea51cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:40 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-371d9cf4-1179-4bc8-813e-8d178713099d tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "cinder-quobyte-377c0c4e-1745-4cc7-9fbc-efb951658103" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:40 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-371d9cf4-1179-4bc8-813e-8d178713099d tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-quobyte-377c0c4e-1745-4cc7-9fbc-efb951658103" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:40 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-371d9cf4-1179-4bc8-813e-8d178713099d tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "cinder-quobyte-3ecbd606-2efd-4b95-9d2d-8ab82eea51cd" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:40 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-371d9cf4-1179-4bc8-813e-8d178713099d tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-quobyte-3ecbd606-2efd-4b95-9d2d-8ab82eea51cd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:40 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-371d9cf4-1179-4bc8-813e-8d178713099d tempest-VolumesSnapshotTestJSON-631116841 None] Deleting offline snapshot 3ecbd606-2efd-4b95-9d2d-8ab82eea51cd of volume 377c0c4e-1745-4cc7-9fbc-efb951658103 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:13:40 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-371d9cf4-1179-4bc8-813e-8d178713099d tempest-VolumesSnapshotTestJSON-631116841 None] snapshot_file for this snap is: volume-377c0c4e-1745-4cc7-9fbc-efb951658103.3ecbd606-2efd-4b95-9d2d-8ab82eea51cd {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:13:40 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36a2487-bb15-4fdb-9d1b-05d42855d90e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-371d9cf4-1179-4bc8-813e-8d178713099d tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103.3ecbd606-2efd-4b95-9d2d-8ab82eea51cd {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:40 devstack sudo[103508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103.3ecbd606-2efd-4b95-9d2d-8ab82eea51cd Sep 01 02:13:40 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:41 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-371d9cf4-1179-4bc8-813e-8d178713099d tempest-VolumesSnapshotTestJSON-631116841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103.3ecbd606-2efd-4b95-9d2d-8ab82eea51cd" returned: 0 in 0.333s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-371d9cf4-1179-4bc8-813e-8d178713099d tempest-VolumesSnapshotTestJSON-631116841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-377c0c4e-1745-4cc7-9fbc-efb951658103(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:13:41 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91b6d2b-7706-40d8-93bc-8b9ccccea521]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-371d9cf4-1179-4bc8-813e-8d178713099d tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:41 devstack sudo[103514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103 Sep 01 02:13:41 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:41 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-371d9cf4-1179-4bc8-813e-8d178713099d tempest-VolumesSnapshotTestJSON-631116841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103" returned: 0 in 0.332s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-371d9cf4-1179-4bc8-813e-8d178713099d tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103.3ecbd606-2efd-4b95-9d2d-8ab82eea51cd {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:41 devstack sudo[103519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103.3ecbd606-2efd-4b95-9d2d-8ab82eea51cd Sep 01 02:13:41 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:41 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-371d9cf4-1179-4bc8-813e-8d178713099d tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103.3ecbd606-2efd-4b95-9d2d-8ab82eea51cd" returned: 0 in 0.318s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-371d9cf4-1179-4bc8-813e-8d178713099d tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103.3ecbd606-2efd-4b95-9d2d-8ab82eea51cd {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:41 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103.3ecbd606-2efd-4b95-9d2d-8ab82eea51cd Sep 01 02:13:41 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:41 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-371d9cf4-1179-4bc8-813e-8d178713099d tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103.3ecbd606-2efd-4b95-9d2d-8ab82eea51cd" returned: 0 in 0.245s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:42 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-371d9cf4-1179-4bc8-813e-8d178713099d tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-quobyte-3ecbd606-2efd-4b95-9d2d-8ab82eea51cd" released by "_delete_snapshot" :: held 1.320s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:42 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-371d9cf4-1179-4bc8-813e-8d178713099d tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-quobyte-377c0c4e-1745-4cc7-9fbc-efb951658103" released by "delete_snapshot" :: held 1.342s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:42 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-371d9cf4-1179-4bc8-813e-8d178713099d tempest-VolumesSnapshotTestJSON-631116841 None] Created reservations ['4b2d3448-b21f-4044-92c2-39cf554f3d25', '61f2d28d-a7ba-4188-8e07-1e67a38f8596', '320e1e38-3c7c-4bf7-acb5-c38351be4322', '58ec1bb7-42a7-4cc0-8ab1-0e975967c1d3'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:42 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-371d9cf4-1179-4bc8-813e-8d178713099d tempest-VolumesSnapshotTestJSON-631116841 None] Delete snapshot completed successfully. Sep 01 02:13:42 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-371d9cf4-1179-4bc8-813e-8d178713099d tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-3ecbd606-2efd-4b95-9d2d-8ab82eea51cd-delete_snapshot" released by "delete_snapshot" :: held 1.507s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:43 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] Flow 'volume_create_manager' (db7a7767-1c8a-4f0e-bc94-7db693d7162f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e09cedbe-a996-4e32-a421-beef98d1eebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e09cedbe-a996-4e32-a421-beef98d1eebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-542802032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd018a5c-c3ee-4305-aafd-84e93d5e9785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd0e64f9ccde458f926eaa5ea24a0856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:43Z,use_quota=True,user_id='899fa30b2f484ca28d59ca322ed73d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (251a80c6-8bdd-4054-bfe5-162159b33435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (251a80c6-8bdd-4054-bfe5-162159b33435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b764a646-0c8a-4a0d-8e07-c907b814d7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b764a646-0c8a-4a0d-8e07-c907b814d7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd018a5c-c3ee-4305-aafd-84e93d5e9785', 'volume_name': 'volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61def81-8b16-413f-86c7-f6d35374de12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61def81-8b16-413f-86c7-f6d35374de12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:43 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b65243f-caee-459d-999f-dbc628e06fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:43 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] Volume cd018a5c-c3ee-4305-aafd-84e93d5e9785: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785', 'volume_size': 1} Sep 01 02:13:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:43 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-542802032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd018a5c-c3ee-4305-aafd-84e93d5e9785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd0e64f9ccde458f926eaa5ea24a0856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:43Z,use_quota=True,user_id='899fa30b2f484ca28d59ca322ed73d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:43 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] Creating volume cd018a5c-c3ee-4305-aafd-84e93d5e9785 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:43 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:43 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:43 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:43 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:13:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:43 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785 1073741824 Sep 01 02:13:43 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:43 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785 1073741824" returned: 0 in 0.382s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:43 devstack sudo[103536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785 Sep 01 02:13:43 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:44 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785" returned: 0 in 0.228s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:44 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] <== create_volume: return (650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.653s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b65243f-caee-459d-999f-dbc628e06fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc482b2e-e6d9-4182-8f31-ec02c02c7fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:44 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] Volume volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785 (cd018a5c-c3ee-4305-aafd-84e93d5e9785): created successfully Sep 01 02:13:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc482b2e-e6d9-4182-8f31-ec02c02c7fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] Flow 'volume_create_manager' (db7a7767-1c8a-4f0e-bc94-7db693d7162f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:44 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-4d93f5b1-7582-48ab-bde6-59478f49a472 tempest-VolumesSnapshotTestJSON-631116841 None] Created volume successfully. Sep 01 02:13:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-25b1c84e-19b0-4cc4-962f-b596938d4bc4 tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-25b1c84e-19b0-4cc4-962f-b596938d4bc4 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:44 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-25b1c84e-19b0-4cc4-962f-b596938d4bc4 tempest-VolumesSnapshotTestJSON-631116841 None] Creating offline snapshot 87a209d5-abef-42b6-a152-39261729c51f of volume cd018a5c-c3ee-4305-aafd-84e93d5e9785 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:13:44 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[f250f29b-0b73-4b8c-bb0d-56777b30539a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-25b1c84e-19b0-4cc4-962f-b596938d4bc4 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:44 devstack sudo[103539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785 Sep 01 02:13:44 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:44 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-25b1c84e-19b0-4cc4-962f-b596938d4bc4 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785" returned: 0 in 0.353s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-25b1c84e-19b0-4cc4-962f-b596938d4bc4 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785.87a209d5-abef-42b6-a152-39261729c51f 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:44 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785.87a209d5-abef-42b6-a152-39261729c51f 1G Sep 01 02:13:44 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:45 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-25b1c84e-19b0-4cc4-962f-b596938d4bc4 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785.87a209d5-abef-42b6-a152-39261729c51f 1G" returned: 0 in 0.386s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-25b1c84e-19b0-4cc4-962f-b596938d4bc4 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785.87a209d5-abef-42b6-a152-39261729c51f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:45 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785.87a209d5-abef-42b6-a152-39261729c51f Sep 01 02:13:45 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:45 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-25b1c84e-19b0-4cc4-962f-b596938d4bc4 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785.87a209d5-abef-42b6-a152-39261729c51f" returned: 0 in 0.304s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:45 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-25b1c84e-19b0-4cc4-962f-b596938d4bc4 tempest-VolumesSnapshotTestJSON-631116841 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785.87a209d5-abef-42b6-a152-39261729c51f is being set with open permissions: ugo+rw Sep 01 02:13:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-25b1c84e-19b0-4cc4-962f-b596938d4bc4 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785.87a209d5-abef-42b6-a152-39261729c51f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:45 devstack sudo[103554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785.87a209d5-abef-42b6-a152-39261729c51f Sep 01 02:13:45 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:45 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-25b1c84e-19b0-4cc4-962f-b596938d4bc4 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785.87a209d5-abef-42b6-a152-39261729c51f" returned: 0 in 0.234s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-25b1c84e-19b0-4cc4-962f-b596938d4bc4 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:45 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785.info Sep 01 02:13:45 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:46 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-25b1c84e-19b0-4cc4-962f-b596938d4bc4 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785.info" returned: 0 in 0.244s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:46 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-25b1c84e-19b0-4cc4-962f-b596938d4bc4 tempest-VolumesSnapshotTestJSON-631116841 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785.info is being set with open permissions: ugo+rw Sep 01 02:13:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-25b1c84e-19b0-4cc4-962f-b596938d4bc4 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:46 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785.info Sep 01 02:13:46 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:46 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-25b1c84e-19b0-4cc4-962f-b596938d4bc4 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785.info" returned: 0 in 0.235s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-25b1c84e-19b0-4cc4-962f-b596938d4bc4 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.838s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:46 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-25b1c84e-19b0-4cc4-962f-b596938d4bc4 tempest-VolumesSnapshotTestJSON-631116841 None] Create snapshot completed successfully Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Flow 'volume_create_manager' (a070ed36-969b-495f-accd-435c43a8c3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (014ee426-3d79-4fd8-b6a2-4b46d9dc16fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (014ee426-3d79-4fd8-b6a2-4b46d9dc16fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-537969177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ac7fdf-3c5b-4430-8657-09972a510b3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd0e64f9ccde458f926eaa5ea24a0856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=87a209d5-abef-42b6-a152-39261729c51f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:47Z,use_quota=True,user_id='899fa30b2f484ca28d59ca322ed73d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3225486-e002-4f62-8de9-680f2d77d7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3225486-e002-4f62-8de9-680f2d77d7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f09f1fda-26d0-4f0c-a1ca-2032f53980b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f09f1fda-26d0-4f0c-a1ca-2032f53980b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '44ac7fdf-3c5b-4430-8657-09972a510b3e', 'volume_name': 'volume-44ac7fdf-3c5b-4430-8657-09972a510b3e', 'volume_size': 2, 'snapshot_id': '87a209d5-abef-42b6-a152-39261729c51f'}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c95378-029b-4f3c-a49a-dee5bc72182f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c95378-029b-4f3c-a49a-dee5bc72182f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a591964-e489-4b13-a48c-eafc5ff25cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:47 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Volume 44ac7fdf-3c5b-4430-8657-09972a510b3e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-44ac7fdf-3c5b-4430-8657-09972a510b3e', 'volume_size': 2, 'snapshot_id': '87a209d5-abef-42b6-a152-39261729c51f'} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "cinder-quobyte-87a209d5-abef-42b6-a152-39261729c51f-44ac7fdf-3c5b-4430-8657-09972a510b3e" by "_create_volume_from_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-quobyte-87a209d5-abef-42b6-a152-39261729c51f-44ac7fdf-3c5b-4430-8657-09972a510b3e" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Creating volume 44ac7fdf-3c5b-4430-8657-09972a510b3e from snapshot 87a209d5-abef-42b6-a152-39261729c51f {{(pid=87128) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "cinder-quobyte-44ac7fdf-3c5b-4430-8657-09972a510b3e" by "_copy_volume_from_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-quobyte-44ac7fdf-3c5b-4430-8657-09972a510b3e" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] snapshot: 87a209d5-abef-42b6-a152-39261729c51f, volume: 44ac7fdf-3c5b-4430-8657-09972a510b3e, {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f598ad-0371-4701-8a7f-b9775ce79c52]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785.87a209d5-abef-42b6-a152-39261729c51f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:47 devstack sudo[103563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785.87a209d5-abef-42b6-a152-39261729c51f Sep 01 02:13:47 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:47 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785.87a209d5-abef-42b6-a152-39261729c51f" returned: 0 in 0.363s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e62bbd7-6637-4200-a7d6-1adb82a6218e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:47 devstack sudo[103568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785 Sep 01 02:13:47 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:47 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785" returned: 0 in 0.358s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785 {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Creating direct copy from snapshot {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG cinder.utils [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Path /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-44ac7fdf-3c5b-4430-8657-09972a510b3e not found in is_blk_device check {{(pid=87128) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:13:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-44ac7fdf-3c5b-4430-8657-09972a510b3e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:48 devstack sudo[103573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-44ac7fdf-3c5b-4430-8657-09972a510b3e Sep 01 02:13:48 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:51 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-44ac7fdf-3c5b-4430-8657-09972a510b3e" returned: 0 in 3.841s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:51 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785, size 1024.00 MB, duration 3.84 sec, destination /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-44ac7fdf-3c5b-4430-8657-09972a510b3e {{(pid=87128) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:13:51 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Converted 1024.00 MB image at 266.50 MB/s Sep 01 02:13:51 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-44ac7fdf-3c5b-4430-8657-09972a510b3e is being set with open permissions: ugo+rw Sep 01 02:13:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-44ac7fdf-3c5b-4430-8657-09972a510b3e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:51 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-44ac7fdf-3c5b-4430-8657-09972a510b3e Sep 01 02:13:51 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:52 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-44ac7fdf-3c5b-4430-8657-09972a510b3e" returned: 0 in 0.229s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-quobyte-44ac7fdf-3c5b-4430-8657-09972a510b3e" released by "_copy_volume_from_snapshot" :: held 4.859s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-quobyte-87a209d5-abef-42b6-a152-39261729c51f-44ac7fdf-3c5b-4430-8657-09972a510b3e" released by "_create_volume_from_snapshot" :: held 4.915s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.929s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a591964-e489-4b13-a48c-eafc5ff25cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44ac7fdf-3c5b-4430-8657-09972a510b3e', 'volume_size': 2, 'snapshot_id': '87a209d5-abef-42b6-a152-39261729c51f'}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b580af26-30d1-4594-83b2-e7a84aaaa63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:52 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Volume volume-44ac7fdf-3c5b-4430-8657-09972a510b3e (44ac7fdf-3c5b-4430-8657-09972a510b3e): created successfully Sep 01 02:13:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b580af26-30d1-4594-83b2-e7a84aaaa63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Flow 'volume_create_manager' (a070ed36-969b-495f-accd-435c43a8c3e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:52 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-e8720a3d-9d93-4973-965a-3c15d7f0ebb4 tempest-VolumesSnapshotTestJSON-631116841 None] Created volume successfully. Sep 01 02:13:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ebe1d865-8c8d-4ae0-a1be-da3eb19873c9 tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "cinder-44ac7fdf-3c5b-4430-8657-09972a510b3e-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ebe1d865-8c8d-4ae0-a1be-da3eb19873c9 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-44ac7fdf-3c5b-4430-8657-09972a510b3e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ebe1d865-8c8d-4ae0-a1be-da3eb19873c9 tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "cinder-quobyte-44ac7fdf-3c5b-4430-8657-09972a510b3e" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ebe1d865-8c8d-4ae0-a1be-da3eb19873c9 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-quobyte-44ac7fdf-3c5b-4430-8657-09972a510b3e" acquired by "delete_volume" :: waited 0.014s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:52 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[04858b52-9f61-4ab2-be4c-f2c83362cba5]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ebe1d865-8c8d-4ae0-a1be-da3eb19873c9 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-44ac7fdf-3c5b-4430-8657-09972a510b3e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:52 devstack sudo[103590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-44ac7fdf-3c5b-4430-8657-09972a510b3e Sep 01 02:13:52 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:53 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ebe1d865-8c8d-4ae0-a1be-da3eb19873c9 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-44ac7fdf-3c5b-4430-8657-09972a510b3e" returned: 0 in 0.333s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ebe1d865-8c8d-4ae0-a1be-da3eb19873c9 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-44ac7fdf-3c5b-4430-8657-09972a510b3e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:53 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-44ac7fdf-3c5b-4430-8657-09972a510b3e Sep 01 02:13:53 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:53 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ebe1d865-8c8d-4ae0-a1be-da3eb19873c9 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-44ac7fdf-3c5b-4430-8657-09972a510b3e" returned: 0 in 0.249s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ebe1d865-8c8d-4ae0-a1be-da3eb19873c9 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-quobyte-44ac7fdf-3c5b-4430-8657-09972a510b3e" released by "delete_volume" :: held 0.619s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:53 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-ebe1d865-8c8d-4ae0-a1be-da3eb19873c9 tempest-VolumesSnapshotTestJSON-631116841 None] Created reservations ['4995d94e-068b-4080-bf96-f6eb9b457656', '435fd10f-039b-4a47-b20e-745ce1efae5c', '8e6cd73e-12b0-40d1-9e0b-1ed0affd6e94', 'e86ebd87-0bec-46ee-99d7-f11dd2712248'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ebe1d865-8c8d-4ae0-a1be-da3eb19873c9 tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ebe1d865-8c8d-4ae0-a1be-da3eb19873c9 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-ebe1d865-8c8d-4ae0-a1be-da3eb19873c9 tempest-VolumesSnapshotTestJSON-631116841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-ebe1d865-8c8d-4ae0-a1be-da3eb19873c9 tempest-VolumesSnapshotTestJSON-631116841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ebe1d865-8c8d-4ae0-a1be-da3eb19873c9 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ebe1d865-8c8d-4ae0-a1be-da3eb19873c9 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:53 devstack sudo[103598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:13:53 devstack sudo[103598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:53 devstack sudo[103598]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ebe1d865-8c8d-4ae0-a1be-da3eb19873c9 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.242s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:53 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-ebe1d865-8c8d-4ae0-a1be-da3eb19873c9 tempest-VolumesSnapshotTestJSON-631116841 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:53 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-ebe1d865-8c8d-4ae0-a1be-da3eb19873c9 tempest-VolumesSnapshotTestJSON-631116841 None] Deleted volume successfully. Sep 01 02:13:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ebe1d865-8c8d-4ae0-a1be-da3eb19873c9 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-44ac7fdf-3c5b-4430-8657-09972a510b3e-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-24990dc0-d6ed-4fd3-8fbd-357df38573ff tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "cinder-87a209d5-abef-42b6-a152-39261729c51f-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-24990dc0-d6ed-4fd3-8fbd-357df38573ff tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-87a209d5-abef-42b6-a152-39261729c51f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-24990dc0-d6ed-4fd3-8fbd-357df38573ff tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "cinder-quobyte-cd018a5c-c3ee-4305-aafd-84e93d5e9785" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-24990dc0-d6ed-4fd3-8fbd-357df38573ff tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-quobyte-cd018a5c-c3ee-4305-aafd-84e93d5e9785" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-24990dc0-d6ed-4fd3-8fbd-357df38573ff tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "cinder-quobyte-87a209d5-abef-42b6-a152-39261729c51f" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-24990dc0-d6ed-4fd3-8fbd-357df38573ff tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-quobyte-87a209d5-abef-42b6-a152-39261729c51f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-24990dc0-d6ed-4fd3-8fbd-357df38573ff tempest-VolumesSnapshotTestJSON-631116841 None] Deleting offline snapshot 87a209d5-abef-42b6-a152-39261729c51f of volume cd018a5c-c3ee-4305-aafd-84e93d5e9785 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:13:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-24990dc0-d6ed-4fd3-8fbd-357df38573ff tempest-VolumesSnapshotTestJSON-631116841 None] snapshot_file for this snap is: volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785.87a209d5-abef-42b6-a152-39261729c51f {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:13:53 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bd83b9-897a-47e7-b584-a7b2364990b4]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-24990dc0-d6ed-4fd3-8fbd-357df38573ff tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785.87a209d5-abef-42b6-a152-39261729c51f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:53 devstack sudo[103601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785.87a209d5-abef-42b6-a152-39261729c51f Sep 01 02:13:53 devstack sudo[103601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:54 devstack sudo[103601]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-24990dc0-d6ed-4fd3-8fbd-357df38573ff tempest-VolumesSnapshotTestJSON-631116841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785.87a209d5-abef-42b6-a152-39261729c51f" returned: 0 in 0.347s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-24990dc0-d6ed-4fd3-8fbd-357df38573ff tempest-VolumesSnapshotTestJSON-631116841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:13:54 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d62ac48-ec45-4b40-9434-aa27e12a819b]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-24990dc0-d6ed-4fd3-8fbd-357df38573ff tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:54 devstack sudo[103606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785 Sep 01 02:13:54 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:54 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-24990dc0-d6ed-4fd3-8fbd-357df38573ff tempest-VolumesSnapshotTestJSON-631116841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785" returned: 0 in 0.500s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-24990dc0-d6ed-4fd3-8fbd-357df38573ff tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785.87a209d5-abef-42b6-a152-39261729c51f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:54 devstack sudo[103611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785.87a209d5-abef-42b6-a152-39261729c51f Sep 01 02:13:54 devstack sudo[103611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:55 devstack sudo[103611]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-24990dc0-d6ed-4fd3-8fbd-357df38573ff tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785.87a209d5-abef-42b6-a152-39261729c51f" returned: 0 in 0.317s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-24990dc0-d6ed-4fd3-8fbd-357df38573ff tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785.87a209d5-abef-42b6-a152-39261729c51f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:55 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785.87a209d5-abef-42b6-a152-39261729c51f Sep 01 02:13:55 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:55 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-24990dc0-d6ed-4fd3-8fbd-357df38573ff tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785.87a209d5-abef-42b6-a152-39261729c51f" returned: 0 in 0.241s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:55 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-24990dc0-d6ed-4fd3-8fbd-357df38573ff tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-quobyte-87a209d5-abef-42b6-a152-39261729c51f" released by "_delete_snapshot" :: held 1.492s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:55 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-24990dc0-d6ed-4fd3-8fbd-357df38573ff tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-quobyte-cd018a5c-c3ee-4305-aafd-84e93d5e9785" released by "delete_snapshot" :: held 1.515s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:55 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-24990dc0-d6ed-4fd3-8fbd-357df38573ff tempest-VolumesSnapshotTestJSON-631116841 None] Created reservations ['4d81933b-559b-4477-9af7-78080898bd56', '6d1f8dba-5d2e-41d1-b8a2-52cd06b7d375', '3c17ba84-8ecc-4e5a-a19b-70c2f2670fc2', 'd50439dd-522c-474f-8fc4-ee6b13fd9b80'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:55 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-24990dc0-d6ed-4fd3-8fbd-357df38573ff tempest-VolumesSnapshotTestJSON-631116841 None] Delete snapshot completed successfully. Sep 01 02:13:55 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-24990dc0-d6ed-4fd3-8fbd-357df38573ff tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-87a209d5-abef-42b6-a152-39261729c51f-delete_snapshot" released by "delete_snapshot" :: held 1.646s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:56 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c7ede21f-64e9-4137-95c9-2cdecb1a19f6 tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "cinder-cd018a5c-c3ee-4305-aafd-84e93d5e9785-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:56 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c7ede21f-64e9-4137-95c9-2cdecb1a19f6 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-cd018a5c-c3ee-4305-aafd-84e93d5e9785-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:56 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c7ede21f-64e9-4137-95c9-2cdecb1a19f6 tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "cinder-quobyte-cd018a5c-c3ee-4305-aafd-84e93d5e9785" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:56 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c7ede21f-64e9-4137-95c9-2cdecb1a19f6 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-quobyte-cd018a5c-c3ee-4305-aafd-84e93d5e9785" acquired by "delete_volume" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:56 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0623a9-a1c2-43a9-b79a-8d72d38e358f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c7ede21f-64e9-4137-95c9-2cdecb1a19f6 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:56 devstack sudo[103621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785 Sep 01 02:13:56 devstack sudo[103621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:56 devstack sudo[103621]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c7ede21f-64e9-4137-95c9-2cdecb1a19f6 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785" returned: 0 in 0.351s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c7ede21f-64e9-4137-95c9-2cdecb1a19f6 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:56 devstack sudo[103626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785 Sep 01 02:13:56 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:56 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c7ede21f-64e9-4137-95c9-2cdecb1a19f6 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd018a5c-c3ee-4305-aafd-84e93d5e9785" returned: 0 in 0.244s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:56 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c7ede21f-64e9-4137-95c9-2cdecb1a19f6 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-quobyte-cd018a5c-c3ee-4305-aafd-84e93d5e9785" released by "delete_volume" :: held 0.650s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:56 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-c7ede21f-64e9-4137-95c9-2cdecb1a19f6 tempest-VolumesSnapshotTestJSON-631116841 None] Created reservations ['61b38a0f-9b3e-44a8-98a3-99f5e3e61c4a', '29c7c3f1-74c5-4c12-b9c2-f8a0c9090ae9', 'f74e0322-812a-4d0f-a3a2-eea98ab04d19', '0da4de82-969b-41ff-80f2-228a0d180838'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c7ede21f-64e9-4137-95c9-2cdecb1a19f6 tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c7ede21f-64e9-4137-95c9-2cdecb1a19f6 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:56 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c7ede21f-64e9-4137-95c9-2cdecb1a19f6 tempest-VolumesSnapshotTestJSON-631116841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:56 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c7ede21f-64e9-4137-95c9-2cdecb1a19f6 tempest-VolumesSnapshotTestJSON-631116841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c7ede21f-64e9-4137-95c9-2cdecb1a19f6 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c7ede21f-64e9-4137-95c9-2cdecb1a19f6 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:56 devstack sudo[103629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:13:56 devstack sudo[103629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:57 devstack sudo[103629]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c7ede21f-64e9-4137-95c9-2cdecb1a19f6 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.248s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:57 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-c7ede21f-64e9-4137-95c9-2cdecb1a19f6 tempest-VolumesSnapshotTestJSON-631116841 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:57 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-c7ede21f-64e9-4137-95c9-2cdecb1a19f6 tempest-VolumesSnapshotTestJSON-631116841 None] Deleted volume successfully. Sep 01 02:13:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c7ede21f-64e9-4137-95c9-2cdecb1a19f6 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-cd018a5c-c3ee-4305-aafd-84e93d5e9785-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:57 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] Flow 'volume_create_manager' (90a11001-1b8b-401b-8d85-80a5b804820f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e83d763-b113-4bc0-a4bd-920efec3d2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e83d763-b113-4bc0-a4bd-920efec3d2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1318716345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c113ea2-1a9f-40d8-9a49-8035fa5840b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd0e64f9ccde458f926eaa5ea24a0856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:58Z,use_quota=True,user_id='899fa30b2f484ca28d59ca322ed73d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b3004a-2f34-459b-b3e4-9a8bf5233550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b3004a-2f34-459b-b3e4-9a8bf5233550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a0bb881-a718-424e-8d98-34c1a691211e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a0bb881-a718-424e-8d98-34c1a691211e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c113ea2-1a9f-40d8-9a49-8035fa5840b2', 'volume_name': 'volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (990002c7-b6ce-4dc9-8458-9183509b9528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (990002c7-b6ce-4dc9-8458-9183509b9528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b90446a4-9d0f-4808-81a5-d6702f08dee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:57 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] Volume 2c113ea2-1a9f-40d8-9a49-8035fa5840b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2', 'volume_size': 1} Sep 01 02:13:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1318716345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c113ea2-1a9f-40d8-9a49-8035fa5840b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd0e64f9ccde458f926eaa5ea24a0856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:58Z,use_quota=True,user_id='899fa30b2f484ca28d59ca322ed73d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] Creating volume 2c113ea2-1a9f-40d8-9a49-8035fa5840b2 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:57 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:13:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:57 devstack sudo[103632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2 1073741824 Sep 01 02:13:57 devstack sudo[103632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:58 devstack sudo[103632]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2 1073741824" returned: 0 in 0.419s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:58 devstack sudo[103637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2 Sep 01 02:13:58 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:58 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2" returned: 0 in 0.242s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b90446a4-9d0f-4808-81a5-d6702f08dee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6040adc1-def8-463b-8d3e-c07fc48c16be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:58 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] Volume volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2 (2c113ea2-1a9f-40d8-9a49-8035fa5840b2): created successfully Sep 01 02:13:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6040adc1-def8-463b-8d3e-c07fc48c16be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] Flow 'volume_create_manager' (90a11001-1b8b-401b-8d85-80a5b804820f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:58 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-79d58531-f0e8-46f6-91a1-6943d47b227b tempest-VolumesSnapshotTestJSON-631116841 None] Created volume successfully. Sep 01 02:13:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-eda1096f-076f-4167-8805-34760543c669 tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-eda1096f-076f-4167-8805-34760543c669 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-eda1096f-076f-4167-8805-34760543c669 tempest-VolumesSnapshotTestJSON-631116841 None] Creating offline snapshot bab772e4-c70e-415d-b5d8-0e167e1abe98 of volume 2c113ea2-1a9f-40d8-9a49-8035fa5840b2 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:13:58 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcea948-ae97-475c-b0f7-3c1c36344ed5]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eda1096f-076f-4167-8805-34760543c669 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:59 devstack sudo[103640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2 Sep 01 02:13:59 devstack sudo[103640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:59 devstack sudo[103640]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eda1096f-076f-4167-8805-34760543c669 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2" returned: 0 in 0.344s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eda1096f-076f-4167-8805-34760543c669 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2.bab772e4-c70e-415d-b5d8-0e167e1abe98 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:59 devstack sudo[103645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2.bab772e4-c70e-415d-b5d8-0e167e1abe98 1G Sep 01 02:13:59 devstack sudo[103645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:59 devstack sudo[103645]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eda1096f-076f-4167-8805-34760543c669 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2.bab772e4-c70e-415d-b5d8-0e167e1abe98 1G" returned: 0 in 0.384s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eda1096f-076f-4167-8805-34760543c669 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2.bab772e4-c70e-415d-b5d8-0e167e1abe98 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:59 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2.bab772e4-c70e-415d-b5d8-0e167e1abe98 Sep 01 02:13:59 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:59 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eda1096f-076f-4167-8805-34760543c669 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2.bab772e4-c70e-415d-b5d8-0e167e1abe98" returned: 0 in 0.293s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:59 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-eda1096f-076f-4167-8805-34760543c669 tempest-VolumesSnapshotTestJSON-631116841 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2.bab772e4-c70e-415d-b5d8-0e167e1abe98 is being set with open permissions: ugo+rw Sep 01 02:13:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eda1096f-076f-4167-8805-34760543c669 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2.bab772e4-c70e-415d-b5d8-0e167e1abe98 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:59 devstack sudo[103655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2.bab772e4-c70e-415d-b5d8-0e167e1abe98 Sep 01 02:13:59 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:00 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eda1096f-076f-4167-8805-34760543c669 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2.bab772e4-c70e-415d-b5d8-0e167e1abe98" returned: 0 in 0.235s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eda1096f-076f-4167-8805-34760543c669 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:00 devstack sudo[103658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2.info Sep 01 02:14:00 devstack sudo[103658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:00 devstack sudo[103658]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eda1096f-076f-4167-8805-34760543c669 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2.info" returned: 0 in 0.240s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:00 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-eda1096f-076f-4167-8805-34760543c669 tempest-VolumesSnapshotTestJSON-631116841 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2.info is being set with open permissions: ugo+rw Sep 01 02:14:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eda1096f-076f-4167-8805-34760543c669 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:00 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2.info Sep 01 02:14:00 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:00 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eda1096f-076f-4167-8805-34760543c669 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2.info" returned: 0 in 0.233s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-eda1096f-076f-4167-8805-34760543c669 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.807s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:00 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-eda1096f-076f-4167-8805-34760543c669 tempest-VolumesSnapshotTestJSON-631116841 None] Create snapshot completed successfully Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Flow 'volume_create_manager' (28c2aa7d-3b05-4cf2-bc8f-33d274da0e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec94f3ba-587d-4904-92fc-b92ff3f0e718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec94f3ba-587d-4904-92fc-b92ff3f0e718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1818179193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7ff54f7-6361-476c-9e88-c390d549036f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd0e64f9ccde458f926eaa5ea24a0856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bab772e4-c70e-415d-b5d8-0e167e1abe98,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:01Z,use_quota=True,user_id='899fa30b2f484ca28d59ca322ed73d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e657da-c634-4fe8-b49d-e7dd10526a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e657da-c634-4fe8-b49d-e7dd10526a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1257ac59-fcbe-4c83-9a32-277e6627cc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1257ac59-fcbe-4c83-9a32-277e6627cc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b7ff54f7-6361-476c-9e88-c390d549036f', 'volume_name': 'volume-b7ff54f7-6361-476c-9e88-c390d549036f', 'volume_size': 1, 'snapshot_id': 'bab772e4-c70e-415d-b5d8-0e167e1abe98'}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba2d952-0cd5-40a7-b184-86050298f30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba2d952-0cd5-40a7-b184-86050298f30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f4b69b5-b6bb-4c96-848c-c567f1fa3a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:01 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Volume b7ff54f7-6361-476c-9e88-c390d549036f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b7ff54f7-6361-476c-9e88-c390d549036f', 'volume_size': 1, 'snapshot_id': 'bab772e4-c70e-415d-b5d8-0e167e1abe98'} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "cinder-quobyte-bab772e4-c70e-415d-b5d8-0e167e1abe98-b7ff54f7-6361-476c-9e88-c390d549036f" by "_create_volume_from_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-quobyte-bab772e4-c70e-415d-b5d8-0e167e1abe98-b7ff54f7-6361-476c-9e88-c390d549036f" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Creating volume b7ff54f7-6361-476c-9e88-c390d549036f from snapshot bab772e4-c70e-415d-b5d8-0e167e1abe98 {{(pid=87128) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "cinder-quobyte-b7ff54f7-6361-476c-9e88-c390d549036f" by "_copy_volume_from_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-quobyte-b7ff54f7-6361-476c-9e88-c390d549036f" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] snapshot: bab772e4-c70e-415d-b5d8-0e167e1abe98, volume: b7ff54f7-6361-476c-9e88-c390d549036f, {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f09abf-88e9-4bb6-9cd2-43c1451e9368]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2.bab772e4-c70e-415d-b5d8-0e167e1abe98 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:01 devstack sudo[103664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2.bab772e4-c70e-415d-b5d8-0e167e1abe98 Sep 01 02:14:01 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:02 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2.bab772e4-c70e-415d-b5d8-0e167e1abe98" returned: 0 in 0.374s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:14:02 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e2bc4a-add0-445b-b4c3-f20d562f8a14]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:02 devstack sudo[103670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2 Sep 01 02:14:02 devstack sudo[103670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:02 devstack sudo[103670]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2" returned: 0 in 0.367s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2 {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:14:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Creating direct copy from snapshot {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:14:02 devstack cinder-volume[87128]: DEBUG cinder.utils [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Path /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b7ff54f7-6361-476c-9e88-c390d549036f not found in is_blk_device check {{(pid=87128) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:14:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b7ff54f7-6361-476c-9e88-c390d549036f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:02 devstack sudo[103675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b7ff54f7-6361-476c-9e88-c390d549036f Sep 01 02:14:02 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:06 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b7ff54f7-6361-476c-9e88-c390d549036f" returned: 0 in 3.750s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:06 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2, size 1024.00 MB, duration 3.75 sec, destination /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b7ff54f7-6361-476c-9e88-c390d549036f {{(pid=87128) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:14:06 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Converted 1024.00 MB image at 272.99 MB/s Sep 01 02:14:06 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b7ff54f7-6361-476c-9e88-c390d549036f is being set with open permissions: ugo+rw Sep 01 02:14:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b7ff54f7-6361-476c-9e88-c390d549036f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:06 devstack sudo[103688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b7ff54f7-6361-476c-9e88-c390d549036f Sep 01 02:14:06 devstack sudo[103688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:06 devstack sudo[103688]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b7ff54f7-6361-476c-9e88-c390d549036f" returned: 0 in 0.226s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:06 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-quobyte-b7ff54f7-6361-476c-9e88-c390d549036f" released by "_copy_volume_from_snapshot" :: held 4.800s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:06 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-quobyte-bab772e4-c70e-415d-b5d8-0e167e1abe98-b7ff54f7-6361-476c-9e88-c390d549036f" released by "_create_volume_from_snapshot" :: held 4.858s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.879s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f4b69b5-b6bb-4c96-848c-c567f1fa3a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7ff54f7-6361-476c-9e88-c390d549036f', 'volume_size': 1, 'snapshot_id': 'bab772e4-c70e-415d-b5d8-0e167e1abe98'}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5539abb-917e-4026-a98c-d1c8b2226327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:06 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Volume volume-b7ff54f7-6361-476c-9e88-c390d549036f (b7ff54f7-6361-476c-9e88-c390d549036f): created successfully Sep 01 02:14:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5539abb-917e-4026-a98c-d1c8b2226327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Flow 'volume_create_manager' (28c2aa7d-3b05-4cf2-bc8f-33d274da0e1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:06 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-cfd9b9f7-84ec-496e-b7f7-12cd443971d9 tempest-VolumesSnapshotTestJSON-631116841 None] Created volume successfully. Sep 01 02:14:06 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-142637ef-9e5f-45ab-bd3c-ff6f6bcecf4c tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "cinder-b7ff54f7-6361-476c-9e88-c390d549036f-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:07 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-142637ef-9e5f-45ab-bd3c-ff6f6bcecf4c tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-b7ff54f7-6361-476c-9e88-c390d549036f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:07 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-142637ef-9e5f-45ab-bd3c-ff6f6bcecf4c tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "cinder-quobyte-b7ff54f7-6361-476c-9e88-c390d549036f" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:07 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-142637ef-9e5f-45ab-bd3c-ff6f6bcecf4c tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-quobyte-b7ff54f7-6361-476c-9e88-c390d549036f" acquired by "delete_volume" :: waited 0.014s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:07 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[59185632-71a8-4b73-a784-95c33be37ad1]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-142637ef-9e5f-45ab-bd3c-ff6f6bcecf4c tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b7ff54f7-6361-476c-9e88-c390d549036f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:07 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b7ff54f7-6361-476c-9e88-c390d549036f Sep 01 02:14:07 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:07 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-142637ef-9e5f-45ab-bd3c-ff6f6bcecf4c tempest-VolumesSnapshotTestJSON-631116841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b7ff54f7-6361-476c-9e88-c390d549036f" returned: 0 in 0.395s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-142637ef-9e5f-45ab-bd3c-ff6f6bcecf4c tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b7ff54f7-6361-476c-9e88-c390d549036f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:07 devstack sudo[103696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b7ff54f7-6361-476c-9e88-c390d549036f Sep 01 02:14:07 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:07 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-142637ef-9e5f-45ab-bd3c-ff6f6bcecf4c tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b7ff54f7-6361-476c-9e88-c390d549036f" returned: 0 in 0.244s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:07 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-142637ef-9e5f-45ab-bd3c-ff6f6bcecf4c tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-quobyte-b7ff54f7-6361-476c-9e88-c390d549036f" released by "delete_volume" :: held 0.673s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:07 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-142637ef-9e5f-45ab-bd3c-ff6f6bcecf4c tempest-VolumesSnapshotTestJSON-631116841 None] Created reservations ['27037e50-6e43-4758-aa3f-b0f8e23e347e', '708891f8-3842-46b9-a8d3-c05fb1c98d05', 'ad3a5878-5734-4823-9088-d02c13a742af', 'd57e81b0-49e0-4e42-b39c-e1aed71f46e1'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-142637ef-9e5f-45ab-bd3c-ff6f6bcecf4c tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-142637ef-9e5f-45ab-bd3c-ff6f6bcecf4c tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:07 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-142637ef-9e5f-45ab-bd3c-ff6f6bcecf4c tempest-VolumesSnapshotTestJSON-631116841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:07 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-142637ef-9e5f-45ab-bd3c-ff6f6bcecf4c tempest-VolumesSnapshotTestJSON-631116841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-142637ef-9e5f-45ab-bd3c-ff6f6bcecf4c tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-142637ef-9e5f-45ab-bd3c-ff6f6bcecf4c tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:07 devstack sudo[103699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:14:07 devstack sudo[103699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:08 devstack sudo[103699]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-142637ef-9e5f-45ab-bd3c-ff6f6bcecf4c tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.245s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:08 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-142637ef-9e5f-45ab-bd3c-ff6f6bcecf4c tempest-VolumesSnapshotTestJSON-631116841 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:08 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-142637ef-9e5f-45ab-bd3c-ff6f6bcecf4c tempest-VolumesSnapshotTestJSON-631116841 None] Deleted volume successfully. Sep 01 02:14:08 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-142637ef-9e5f-45ab-bd3c-ff6f6bcecf4c tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-b7ff54f7-6361-476c-9e88-c390d549036f-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:08 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c519b26f-7cb1-4d6e-a9cc-796fd686a4ca tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "cinder-bab772e4-c70e-415d-b5d8-0e167e1abe98-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:08 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c519b26f-7cb1-4d6e-a9cc-796fd686a4ca tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-bab772e4-c70e-415d-b5d8-0e167e1abe98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:08 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c519b26f-7cb1-4d6e-a9cc-796fd686a4ca tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "cinder-quobyte-2c113ea2-1a9f-40d8-9a49-8035fa5840b2" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:08 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c519b26f-7cb1-4d6e-a9cc-796fd686a4ca tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-quobyte-2c113ea2-1a9f-40d8-9a49-8035fa5840b2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:08 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c519b26f-7cb1-4d6e-a9cc-796fd686a4ca tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "cinder-quobyte-bab772e4-c70e-415d-b5d8-0e167e1abe98" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:08 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c519b26f-7cb1-4d6e-a9cc-796fd686a4ca tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-quobyte-bab772e4-c70e-415d-b5d8-0e167e1abe98" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-c519b26f-7cb1-4d6e-a9cc-796fd686a4ca tempest-VolumesSnapshotTestJSON-631116841 None] Deleting offline snapshot bab772e4-c70e-415d-b5d8-0e167e1abe98 of volume 2c113ea2-1a9f-40d8-9a49-8035fa5840b2 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:14:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-c519b26f-7cb1-4d6e-a9cc-796fd686a4ca tempest-VolumesSnapshotTestJSON-631116841 None] snapshot_file for this snap is: volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2.bab772e4-c70e-415d-b5d8-0e167e1abe98 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:14:08 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[764ee0e4-cff3-42e0-888f-de032c937407]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c519b26f-7cb1-4d6e-a9cc-796fd686a4ca tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2.bab772e4-c70e-415d-b5d8-0e167e1abe98 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:08 devstack sudo[103702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2.bab772e4-c70e-415d-b5d8-0e167e1abe98 Sep 01 02:14:08 devstack sudo[103702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:08 devstack sudo[103702]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c519b26f-7cb1-4d6e-a9cc-796fd686a4ca tempest-VolumesSnapshotTestJSON-631116841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2.bab772e4-c70e-415d-b5d8-0e167e1abe98" returned: 0 in 0.342s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-c519b26f-7cb1-4d6e-a9cc-796fd686a4ca tempest-VolumesSnapshotTestJSON-631116841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:14:08 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53cff36-5777-4aa5-95a3-f25b099bf816]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c519b26f-7cb1-4d6e-a9cc-796fd686a4ca tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:08 devstack sudo[103707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2 Sep 01 02:14:08 devstack sudo[103707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:09 devstack sudo[103707]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c519b26f-7cb1-4d6e-a9cc-796fd686a4ca tempest-VolumesSnapshotTestJSON-631116841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2" returned: 0 in 0.557s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c519b26f-7cb1-4d6e-a9cc-796fd686a4ca tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2.bab772e4-c70e-415d-b5d8-0e167e1abe98 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:09 devstack sudo[103712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2.bab772e4-c70e-415d-b5d8-0e167e1abe98 Sep 01 02:14:09 devstack sudo[103712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:09 devstack sudo[103712]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c519b26f-7cb1-4d6e-a9cc-796fd686a4ca tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2.bab772e4-c70e-415d-b5d8-0e167e1abe98" returned: 0 in 0.321s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c519b26f-7cb1-4d6e-a9cc-796fd686a4ca tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2.bab772e4-c70e-415d-b5d8-0e167e1abe98 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:09 devstack sudo[103717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2.bab772e4-c70e-415d-b5d8-0e167e1abe98 Sep 01 02:14:09 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:09 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c519b26f-7cb1-4d6e-a9cc-796fd686a4ca tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2.bab772e4-c70e-415d-b5d8-0e167e1abe98" returned: 0 in 0.252s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:09 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c519b26f-7cb1-4d6e-a9cc-796fd686a4ca tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-quobyte-bab772e4-c70e-415d-b5d8-0e167e1abe98" released by "_delete_snapshot" :: held 1.564s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:09 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c519b26f-7cb1-4d6e-a9cc-796fd686a4ca tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-quobyte-2c113ea2-1a9f-40d8-9a49-8035fa5840b2" released by "delete_snapshot" :: held 1.585s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:09 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-c519b26f-7cb1-4d6e-a9cc-796fd686a4ca tempest-VolumesSnapshotTestJSON-631116841 None] Created reservations ['02648abe-e140-46b8-8f6f-3f571f81f760', '3e4322de-4c6e-485b-bf64-bb7fbbae4162', '19c3d0c5-8f5b-4168-abb3-2384ef7da51e', 'cdfe30d4-2cd3-4a3a-aa0a-eb32f2f5c8a9'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:09 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-c519b26f-7cb1-4d6e-a9cc-796fd686a4ca tempest-VolumesSnapshotTestJSON-631116841 None] Delete snapshot completed successfully. Sep 01 02:14:09 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c519b26f-7cb1-4d6e-a9cc-796fd686a4ca tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-bab772e4-c70e-415d-b5d8-0e167e1abe98-delete_snapshot" released by "delete_snapshot" :: held 1.722s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:10 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9477ab4f-4902-4203-8b9e-15ca6372981e tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "cinder-2c113ea2-1a9f-40d8-9a49-8035fa5840b2-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:10 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9477ab4f-4902-4203-8b9e-15ca6372981e tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-2c113ea2-1a9f-40d8-9a49-8035fa5840b2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:10 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9477ab4f-4902-4203-8b9e-15ca6372981e tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "cinder-quobyte-2c113ea2-1a9f-40d8-9a49-8035fa5840b2" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:10 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9477ab4f-4902-4203-8b9e-15ca6372981e tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-quobyte-2c113ea2-1a9f-40d8-9a49-8035fa5840b2" acquired by "delete_volume" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:10 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[de60d8e7-2994-4eb4-935f-63b1e3bb5db2]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9477ab4f-4902-4203-8b9e-15ca6372981e tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:10 devstack sudo[103727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2 Sep 01 02:14:10 devstack sudo[103727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:10 devstack sudo[103727]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9477ab4f-4902-4203-8b9e-15ca6372981e tempest-VolumesSnapshotTestJSON-631116841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2" returned: 0 in 0.344s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9477ab4f-4902-4203-8b9e-15ca6372981e tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:10 devstack sudo[103732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2 Sep 01 02:14:10 devstack sudo[103732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:11 devstack sudo[103732]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9477ab4f-4902-4203-8b9e-15ca6372981e tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2c113ea2-1a9f-40d8-9a49-8035fa5840b2" returned: 0 in 0.230s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9477ab4f-4902-4203-8b9e-15ca6372981e tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-quobyte-2c113ea2-1a9f-40d8-9a49-8035fa5840b2" released by "delete_volume" :: held 0.654s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:11 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-9477ab4f-4902-4203-8b9e-15ca6372981e tempest-VolumesSnapshotTestJSON-631116841 None] Created reservations ['6146962a-aee7-4032-9bb2-6ed61fadb705', '6599c9d7-eae8-449a-8bdb-b83870cbc8d5', '9ed2a268-ee45-43fb-9b2c-8f5498148987', 'de204bd6-acde-4539-9816-c5c8a65462e0'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9477ab4f-4902-4203-8b9e-15ca6372981e tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9477ab4f-4902-4203-8b9e-15ca6372981e tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:11 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-9477ab4f-4902-4203-8b9e-15ca6372981e tempest-VolumesSnapshotTestJSON-631116841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:11 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-9477ab4f-4902-4203-8b9e-15ca6372981e tempest-VolumesSnapshotTestJSON-631116841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9477ab4f-4902-4203-8b9e-15ca6372981e tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9477ab4f-4902-4203-8b9e-15ca6372981e tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:11 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:14:11 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:11 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9477ab4f-4902-4203-8b9e-15ca6372981e tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.226s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:11 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-9477ab4f-4902-4203-8b9e-15ca6372981e tempest-VolumesSnapshotTestJSON-631116841 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:11 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-9477ab4f-4902-4203-8b9e-15ca6372981e tempest-VolumesSnapshotTestJSON-631116841 None] Deleted volume successfully. Sep 01 02:14:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9477ab4f-4902-4203-8b9e-15ca6372981e tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-2c113ea2-1a9f-40d8-9a49-8035fa5840b2-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2d9ccd9b-881d-471b-9c43-5c87325ae549 tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "cinder-377c0c4e-1745-4cc7-9fbc-efb951658103-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2d9ccd9b-881d-471b-9c43-5c87325ae549 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-377c0c4e-1745-4cc7-9fbc-efb951658103-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2d9ccd9b-881d-471b-9c43-5c87325ae549 tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "cinder-quobyte-377c0c4e-1745-4cc7-9fbc-efb951658103" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2d9ccd9b-881d-471b-9c43-5c87325ae549 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-quobyte-377c0c4e-1745-4cc7-9fbc-efb951658103" acquired by "delete_volume" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:11 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43c40f6-2c5b-4166-bd09-d16940e64e17]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2d9ccd9b-881d-471b-9c43-5c87325ae549 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:11 devstack sudo[103738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103 Sep 01 02:14:11 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:12 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2d9ccd9b-881d-471b-9c43-5c87325ae549 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103" returned: 0 in 0.327s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2d9ccd9b-881d-471b-9c43-5c87325ae549 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:12 devstack sudo[103744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103 Sep 01 02:14:12 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:12 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2d9ccd9b-881d-471b-9c43-5c87325ae549 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-377c0c4e-1745-4cc7-9fbc-efb951658103" returned: 0 in 0.226s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:12 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2d9ccd9b-881d-471b-9c43-5c87325ae549 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-quobyte-377c0c4e-1745-4cc7-9fbc-efb951658103" released by "delete_volume" :: held 0.603s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:12 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-2d9ccd9b-881d-471b-9c43-5c87325ae549 tempest-VolumesSnapshotTestJSON-631116841 None] Created reservations ['8b6f07bd-e1c2-43e8-8203-ecdba98f2053', '4d3eedef-a3c9-458d-b717-b7a766752ed4', 'f9d46ffb-b17f-42c1-a11e-69633cfee62e', '0fd93f37-6e68-4222-9923-bf3f4d05c5aa'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2d9ccd9b-881d-471b-9c43-5c87325ae549 tempest-VolumesSnapshotTestJSON-631116841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2d9ccd9b-881d-471b-9c43-5c87325ae549 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:12 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2d9ccd9b-881d-471b-9c43-5c87325ae549 tempest-VolumesSnapshotTestJSON-631116841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:12 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2d9ccd9b-881d-471b-9c43-5c87325ae549 tempest-VolumesSnapshotTestJSON-631116841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2d9ccd9b-881d-471b-9c43-5c87325ae549 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2d9ccd9b-881d-471b-9c43-5c87325ae549 tempest-VolumesSnapshotTestJSON-631116841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:12 devstack sudo[103747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:14:12 devstack sudo[103747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:12 devstack sudo[103747]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2d9ccd9b-881d-471b-9c43-5c87325ae549 tempest-VolumesSnapshotTestJSON-631116841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.234s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:12 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-2d9ccd9b-881d-471b-9c43-5c87325ae549 tempest-VolumesSnapshotTestJSON-631116841 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:12 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-2d9ccd9b-881d-471b-9c43-5c87325ae549 tempest-VolumesSnapshotTestJSON-631116841 None] Deleted volume successfully. Sep 01 02:14:12 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2d9ccd9b-881d-471b-9c43-5c87325ae549 tempest-VolumesSnapshotTestJSON-631116841 None] Lock "cinder-377c0c4e-1745-4cc7-9fbc-efb951658103-delete_volume" released by "delete_volume" :: held 1.006s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:16 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:14:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:17 devstack sudo[103753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:14:17 devstack sudo[103753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:17 devstack sudo[103753]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.255s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:17 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:17 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager._thread_info {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:14:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread count: 29 {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:14:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread info: [<_MainThread(MainThread, started 128688016527488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:14:18 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Flow 'volume_create_manager' (687101f1-6b90-491f-9058-f85812821555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53fb86f-f211-4dd4-a374-dbfc9af25a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53fb86f-f211-4dd4-a374-dbfc9af25a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1352684896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8db869-394a-4005-a2e7-66b76cfe2298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98cde89cfa2a440db50a502a320c24dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:19Z,use_quota=True,user_id='d3e3262f226a4de7b5f3e05b0e9ae93b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d608d125-2d7c-45d4-809f-bdb8b974ae69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d608d125-2d7c-45d4-809f-bdb8b974ae69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f326aa6-66ef-49ee-bd39-075c94c53bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f326aa6-66ef-49ee-bd39-075c94c53bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c8db869-394a-4005-a2e7-66b76cfe2298', 'volume_name': 'volume-0c8db869-394a-4005-a2e7-66b76cfe2298', 'volume_size': 2}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b12e2e-0816-466e-8971-3e826851d9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b12e2e-0816-466e-8971-3e826851d9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bed2334-a6e2-48b0-9a77-384799a085f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:18 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Volume 0c8db869-394a-4005-a2e7-66b76cfe2298: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c8db869-394a-4005-a2e7-66b76cfe2298', 'volume_size': 2} Sep 01 02:14:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1352684896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8db869-394a-4005-a2e7-66b76cfe2298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98cde89cfa2a440db50a502a320c24dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:19Z,use_quota=True,user_id='d3e3262f226a4de7b5f3e05b0e9ae93b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Creating volume 0c8db869-394a-4005-a2e7-66b76cfe2298 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:18 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:14:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298 2147483648 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:18 devstack sudo[103756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298 2147483648 Sep 01 02:14:18 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:19 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298 2147483648" returned: 0 in 0.451s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:19 devstack sudo[103762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298 Sep 01 02:14:19 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:19 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298" returned: 0 in 0.242s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:19 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bed2334-a6e2-48b0-9a77-384799a085f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c8db869-394a-4005-a2e7-66b76cfe2298', 'volume_size': 2}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49b93d7-0143-48a7-a0a3-1f4f5e2c859e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:19 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Volume volume-0c8db869-394a-4005-a2e7-66b76cfe2298 (0c8db869-394a-4005-a2e7-66b76cfe2298): created successfully Sep 01 02:14:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49b93d7-0143-48a7-a0a3-1f4f5e2c859e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Flow 'volume_create_manager' (687101f1-6b90-491f-9058-f85812821555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:19 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-8d2d8bbf-d48c-4c95-bc90-3d8f866f0826 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Created volume successfully. Sep 01 02:14:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-57c7c98f-c9e9-46f3-9782-03d5982fb5ff tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-57c7c98f-c9e9-46f3-9782-03d5982fb5ff tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:19 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-57c7c98f-c9e9-46f3-9782-03d5982fb5ff tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Creating offline snapshot 796cd9f0-70fe-49df-a17f-dc8bdddcbaf1 of volume 0c8db869-394a-4005-a2e7-66b76cfe2298 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:14:20 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c68479f-4e16-4bf8-b296-2d338d75e03d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-57c7c98f-c9e9-46f3-9782-03d5982fb5ff tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:20 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298 Sep 01 02:14:20 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:20 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-57c7c98f-c9e9-46f3-9782-03d5982fb5ff tempest-VolumesSnapshotNegativeTestJSON-85036207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298" returned: 0 in 0.364s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-57c7c98f-c9e9-46f3-9782-03d5982fb5ff tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298.796cd9f0-70fe-49df-a17f-dc8bdddcbaf1 2G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:20 devstack sudo[103770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298.796cd9f0-70fe-49df-a17f-dc8bdddcbaf1 2G Sep 01 02:14:20 devstack sudo[103770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:20 devstack sudo[103770]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-57c7c98f-c9e9-46f3-9782-03d5982fb5ff tempest-VolumesSnapshotNegativeTestJSON-85036207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298.796cd9f0-70fe-49df-a17f-dc8bdddcbaf1 2G" returned: 0 in 0.368s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-57c7c98f-c9e9-46f3-9782-03d5982fb5ff tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c8db869-394a-4005-a2e7-66b76cfe2298 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298.796cd9f0-70fe-49df-a17f-dc8bdddcbaf1 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:20 devstack sudo[103775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c8db869-394a-4005-a2e7-66b76cfe2298 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298.796cd9f0-70fe-49df-a17f-dc8bdddcbaf1 Sep 01 02:14:20 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:21 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-57c7c98f-c9e9-46f3-9782-03d5982fb5ff tempest-VolumesSnapshotNegativeTestJSON-85036207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c8db869-394a-4005-a2e7-66b76cfe2298 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298.796cd9f0-70fe-49df-a17f-dc8bdddcbaf1" returned: 0 in 0.275s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:21 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-57c7c98f-c9e9-46f3-9782-03d5982fb5ff tempest-VolumesSnapshotNegativeTestJSON-85036207 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298.796cd9f0-70fe-49df-a17f-dc8bdddcbaf1 is being set with open permissions: ugo+rw Sep 01 02:14:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-57c7c98f-c9e9-46f3-9782-03d5982fb5ff tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298.796cd9f0-70fe-49df-a17f-dc8bdddcbaf1 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:21 devstack sudo[103780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298.796cd9f0-70fe-49df-a17f-dc8bdddcbaf1 Sep 01 02:14:21 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:21 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-57c7c98f-c9e9-46f3-9782-03d5982fb5ff tempest-VolumesSnapshotNegativeTestJSON-85036207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298.796cd9f0-70fe-49df-a17f-dc8bdddcbaf1" returned: 0 in 0.232s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-57c7c98f-c9e9-46f3-9782-03d5982fb5ff tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:21 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298.info Sep 01 02:14:21 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:21 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-57c7c98f-c9e9-46f3-9782-03d5982fb5ff tempest-VolumesSnapshotNegativeTestJSON-85036207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298.info" returned: 0 in 0.245s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:21 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-57c7c98f-c9e9-46f3-9782-03d5982fb5ff tempest-VolumesSnapshotNegativeTestJSON-85036207 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298.info is being set with open permissions: ugo+rw Sep 01 02:14:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-57c7c98f-c9e9-46f3-9782-03d5982fb5ff tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:21 devstack sudo[103786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298.info Sep 01 02:14:21 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:21 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-57c7c98f-c9e9-46f3-9782-03d5982fb5ff tempest-VolumesSnapshotNegativeTestJSON-85036207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298.info" returned: 0 in 0.232s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-57c7c98f-c9e9-46f3-9782-03d5982fb5ff tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.790s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:21 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-57c7c98f-c9e9-46f3-9782-03d5982fb5ff tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Create snapshot completed successfully Sep 01 02:14:22 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-08b8b83f-ca4b-4ff3-9876-72d706a3e9e3 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Acquiring lock "cinder-796cd9f0-70fe-49df-a17f-dc8bdddcbaf1-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:22 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-08b8b83f-ca4b-4ff3-9876-72d706a3e9e3 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Lock "cinder-796cd9f0-70fe-49df-a17f-dc8bdddcbaf1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:22 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-08b8b83f-ca4b-4ff3-9876-72d706a3e9e3 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Acquiring lock "cinder-quobyte-0c8db869-394a-4005-a2e7-66b76cfe2298" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:22 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-08b8b83f-ca4b-4ff3-9876-72d706a3e9e3 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Lock "cinder-quobyte-0c8db869-394a-4005-a2e7-66b76cfe2298" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:22 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-08b8b83f-ca4b-4ff3-9876-72d706a3e9e3 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Acquiring lock "cinder-quobyte-796cd9f0-70fe-49df-a17f-dc8bdddcbaf1" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:22 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-08b8b83f-ca4b-4ff3-9876-72d706a3e9e3 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Lock "cinder-quobyte-796cd9f0-70fe-49df-a17f-dc8bdddcbaf1" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:22 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-08b8b83f-ca4b-4ff3-9876-72d706a3e9e3 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Deleting offline snapshot 796cd9f0-70fe-49df-a17f-dc8bdddcbaf1 of volume 0c8db869-394a-4005-a2e7-66b76cfe2298 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:14:22 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-08b8b83f-ca4b-4ff3-9876-72d706a3e9e3 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] snapshot_file for this snap is: volume-0c8db869-394a-4005-a2e7-66b76cfe2298.796cd9f0-70fe-49df-a17f-dc8bdddcbaf1 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:14:22 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[db67adf8-2f7a-4249-9dcc-14dcc4510a14]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-08b8b83f-ca4b-4ff3-9876-72d706a3e9e3 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298.796cd9f0-70fe-49df-a17f-dc8bdddcbaf1 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:22 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298.796cd9f0-70fe-49df-a17f-dc8bdddcbaf1 Sep 01 02:14:22 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:22 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-08b8b83f-ca4b-4ff3-9876-72d706a3e9e3 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298.796cd9f0-70fe-49df-a17f-dc8bdddcbaf1" returned: 0 in 0.355s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:22 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-08b8b83f-ca4b-4ff3-9876-72d706a3e9e3 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c8db869-394a-4005-a2e7-66b76cfe2298(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:14:22 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bde9b8b-f96b-4a11-a70f-5c8b7f1fe766]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-08b8b83f-ca4b-4ff3-9876-72d706a3e9e3 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:22 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298 Sep 01 02:14:22 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:22 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-08b8b83f-ca4b-4ff3-9876-72d706a3e9e3 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298" returned: 0 in 0.345s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-08b8b83f-ca4b-4ff3-9876-72d706a3e9e3 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298.796cd9f0-70fe-49df-a17f-dc8bdddcbaf1 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:22 devstack sudo[103801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298.796cd9f0-70fe-49df-a17f-dc8bdddcbaf1 Sep 01 02:14:22 devstack sudo[103801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:23 devstack sudo[103801]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-08b8b83f-ca4b-4ff3-9876-72d706a3e9e3 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298.796cd9f0-70fe-49df-a17f-dc8bdddcbaf1" returned: 0 in 0.336s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-08b8b83f-ca4b-4ff3-9876-72d706a3e9e3 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298.796cd9f0-70fe-49df-a17f-dc8bdddcbaf1 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:23 devstack sudo[103806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298.796cd9f0-70fe-49df-a17f-dc8bdddcbaf1 Sep 01 02:14:23 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:23 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-08b8b83f-ca4b-4ff3-9876-72d706a3e9e3 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298.796cd9f0-70fe-49df-a17f-dc8bdddcbaf1" returned: 0 in 0.238s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-08b8b83f-ca4b-4ff3-9876-72d706a3e9e3 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Lock "cinder-quobyte-796cd9f0-70fe-49df-a17f-dc8bdddcbaf1" released by "_delete_snapshot" :: held 1.375s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-08b8b83f-ca4b-4ff3-9876-72d706a3e9e3 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Lock "cinder-quobyte-0c8db869-394a-4005-a2e7-66b76cfe2298" released by "delete_snapshot" :: held 1.393s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:23 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-08b8b83f-ca4b-4ff3-9876-72d706a3e9e3 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Created reservations ['dde09449-555c-42a9-8efd-bb1ec76aec9d', '000fcfec-566b-40c8-a956-a82792f52c7d', 'bb29efad-a0d8-4e69-ab5f-be14fc126e7b', 'f5d4efc4-ddae-460f-953a-97aa48b002f1'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:23 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-08b8b83f-ca4b-4ff3-9876-72d706a3e9e3 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Delete snapshot completed successfully. Sep 01 02:14:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-08b8b83f-ca4b-4ff3-9876-72d706a3e9e3 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Lock "cinder-796cd9f0-70fe-49df-a17f-dc8bdddcbaf1-delete_snapshot" released by "delete_snapshot" :: held 1.529s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fd0fcc05-8ed0-4d8f-bf86-9b00b2e79366 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Acquiring lock "cinder-0c8db869-394a-4005-a2e7-66b76cfe2298-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fd0fcc05-8ed0-4d8f-bf86-9b00b2e79366 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Lock "cinder-0c8db869-394a-4005-a2e7-66b76cfe2298-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fd0fcc05-8ed0-4d8f-bf86-9b00b2e79366 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Acquiring lock "cinder-quobyte-0c8db869-394a-4005-a2e7-66b76cfe2298" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fd0fcc05-8ed0-4d8f-bf86-9b00b2e79366 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Lock "cinder-quobyte-0c8db869-394a-4005-a2e7-66b76cfe2298" acquired by "delete_volume" :: waited 0.023s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:24 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[701cbf5f-c3b1-4706-9398-dff30585ecc2]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd0fcc05-8ed0-4d8f-bf86-9b00b2e79366 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:24 devstack sudo[103809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298 Sep 01 02:14:24 devstack sudo[103809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:24 devstack sudo[103809]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd0fcc05-8ed0-4d8f-bf86-9b00b2e79366 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298" returned: 0 in 0.370s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd0fcc05-8ed0-4d8f-bf86-9b00b2e79366 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:24 devstack sudo[103814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298 Sep 01 02:14:24 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:25 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd0fcc05-8ed0-4d8f-bf86-9b00b2e79366 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0c8db869-394a-4005-a2e7-66b76cfe2298" returned: 0 in 0.298s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fd0fcc05-8ed0-4d8f-bf86-9b00b2e79366 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Lock "cinder-quobyte-0c8db869-394a-4005-a2e7-66b76cfe2298" released by "delete_volume" :: held 0.731s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:25 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-fd0fcc05-8ed0-4d8f-bf86-9b00b2e79366 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Created reservations ['36c46d8a-7177-4c8d-899a-0adaaf558b86', '05d6ab80-00bb-42d5-be99-e66fe314093c', 'd8f6fd1f-fa13-4550-9b2d-bde319ccbfec', '8f5da605-6b7e-4a04-a1f0-70c956a31380'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fd0fcc05-8ed0-4d8f-bf86-9b00b2e79366 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fd0fcc05-8ed0-4d8f-bf86-9b00b2e79366 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fd0fcc05-8ed0-4d8f-bf86-9b00b2e79366 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fd0fcc05-8ed0-4d8f-bf86-9b00b2e79366 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fd0fcc05-8ed0-4d8f-bf86-9b00b2e79366 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd0fcc05-8ed0-4d8f-bf86-9b00b2e79366 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:25 devstack sudo[103819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:14:25 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:25 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fd0fcc05-8ed0-4d8f-bf86-9b00b2e79366 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.294s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:25 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-fd0fcc05-8ed0-4d8f-bf86-9b00b2e79366 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:25 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-fd0fcc05-8ed0-4d8f-bf86-9b00b2e79366 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Deleted volume successfully. Sep 01 02:14:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fd0fcc05-8ed0-4d8f-bf86-9b00b2e79366 tempest-VolumesSnapshotNegativeTestJSON-85036207 None] Lock "cinder-0c8db869-394a-4005-a2e7-66b76cfe2298-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:35 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=88,cinder:UPDATE=98,cinder:DELETE=10,cinder:INSERT=21 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:14:43 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=87,cinder:UPDATE=92,cinder:INSERT=29,cinder:DELETE=6 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:14:50 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Flow 'volume_create_manager' (9f20dcd9-4870-4194-858a-bd43164a1c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d02be77e-53f9-4f64-9870-5cd74a07b195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d02be77e-53f9-4f64-9870-5cd74a07b195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-299223235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c584228b-ccf6-4023-8f2a-0c79758d3429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83403c5012c64f249ba9a6fe8aacebef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:51Z,use_quota=True,user_id='d30d47672fa74ba0810f928cf8e99223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b4f97e2-49e3-4c7e-af88-8d59a0867aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b4f97e2-49e3-4c7e-af88-8d59a0867aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (040d3afd-807c-437b-b452-23247e10f635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (040d3afd-807c-437b-b452-23247e10f635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c584228b-ccf6-4023-8f2a-0c79758d3429', 'volume_name': 'volume-c584228b-ccf6-4023-8f2a-0c79758d3429', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78fb94d-cec6-4b56-819c-f68ba66e4119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78fb94d-cec6-4b56-819c-f68ba66e4119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8a2a36-0e64-4c4e-8b59-a99b77363e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:51 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Volume c584228b-ccf6-4023-8f2a-0c79758d3429: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c584228b-ccf6-4023-8f2a-0c79758d3429', 'volume_size': 1} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-299223235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c584228b-ccf6-4023-8f2a-0c79758d3429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83403c5012c64f249ba9a6fe8aacebef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:51Z,use_quota=True,user_id='d30d47672fa74ba0810f928cf8e99223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Creating volume c584228b-ccf6-4023-8f2a-0c79758d3429 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:51 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c584228b-ccf6-4023-8f2a-0c79758d3429 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:51 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c584228b-ccf6-4023-8f2a-0c79758d3429 1073741824 Sep 01 02:14:51 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Flow 'volume_create_manager' (d63e2466-e94b-4211-a7b0-b4dd348bf541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b302188-7fa6-4ae8-bb27-5071e254711d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b302188-7fa6-4ae8-bb27-5071e254711d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1180164649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b682c0c3-e0f8-415c-a8e4-11b11d9b4ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83403c5012c64f249ba9a6fe8aacebef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:51Z,use_quota=True,user_id='d30d47672fa74ba0810f928cf8e99223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (281b9682-225d-4ff2-baec-7ec5ae43ce82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (281b9682-225d-4ff2-baec-7ec5ae43ce82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b80469e-d34f-41be-b27f-c0860a75b4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b80469e-d34f-41be-b27f-c0860a75b4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b682c0c3-e0f8-415c-a8e4-11b11d9b4ab5', 'volume_name': 'volume-b682c0c3-e0f8-415c-a8e4-11b11d9b4ab5', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (753400e5-19f8-4e3d-adc2-7b78460a1887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (753400e5-19f8-4e3d-adc2-7b78460a1887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c1a40b-42d2-4395-ac85-0f7486261a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:51 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Volume b682c0c3-e0f8-415c-a8e4-11b11d9b4ab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b682c0c3-e0f8-415c-a8e4-11b11d9b4ab5', 'volume_size': 1} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:51 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c584228b-ccf6-4023-8f2a-0c79758d3429 1073741824" returned: 0 in 0.493s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c584228b-ccf6-4023-8f2a-0c79758d3429 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:51 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c584228b-ccf6-4023-8f2a-0c79758d3429 Sep 01 02:14:51 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:51 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c584228b-ccf6-4023-8f2a-0c79758d3429" returned: 0 in 0.264s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.480s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1180164649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b682c0c3-e0f8-415c-a8e4-11b11d9b4ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83403c5012c64f249ba9a6fe8aacebef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:51Z,use_quota=True,user_id='d30d47672fa74ba0810f928cf8e99223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Creating volume b682c0c3-e0f8-415c-a8e4-11b11d9b4ab5 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:51 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b682c0c3-e0f8-415c-a8e4-11b11d9b4ab5 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8a2a36-0e64-4c4e-8b59-a99b77363e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c584228b-ccf6-4023-8f2a-0c79758d3429', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:51 devstack sudo[103877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b682c0c3-e0f8-415c-a8e4-11b11d9b4ab5 1073741824 Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4adc9d7-1fb1-40cb-886f-9646e158adf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:51 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:51 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Volume volume-c584228b-ccf6-4023-8f2a-0c79758d3429 (c584228b-ccf6-4023-8f2a-0c79758d3429): created successfully Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4adc9d7-1fb1-40cb-886f-9646e158adf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:51 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Flow 'volume_create_manager' (9f20dcd9-4870-4194-858a-bd43164a1c48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:51 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-7ea00a4d-5170-4239-97c8-be8714117891 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Created volume successfully. Sep 01 02:14:52 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b682c0c3-e0f8-415c-a8e4-11b11d9b4ab5 1073741824" returned: 0 in 0.451s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b682c0c3-e0f8-415c-a8e4-11b11d9b4ab5 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:52 devstack sudo[103883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b682c0c3-e0f8-415c-a8e4-11b11d9b4ab5 Sep 01 02:14:52 devstack sudo[103883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:52 devstack sudo[103883]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b682c0c3-e0f8-415c-a8e4-11b11d9b4ab5" returned: 0 in 0.241s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:52 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c1a40b-42d2-4395-ac85-0f7486261a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b682c0c3-e0f8-415c-a8e4-11b11d9b4ab5', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (882504c5-d7be-4ec7-a286-80613e71a720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:52 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Volume volume-b682c0c3-e0f8-415c-a8e4-11b11d9b4ab5 (b682c0c3-e0f8-415c-a8e4-11b11d9b4ab5): created successfully Sep 01 02:14:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (882504c5-d7be-4ec7-a286-80613e71a720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Flow 'volume_create_manager' (d63e2466-e94b-4211-a7b0-b4dd348bf541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:52 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-d91a5f13-a11b-4fbb-b91f-d6be041bb246 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Created volume successfully. Sep 01 02:15:02 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=3,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:15:02 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:UPDATE=5,cinder:SELECT=5,cinder:DELETE=2,cinder:INSERT=1 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:15:16 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:15:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:17 devstack sudo[104002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:15:17 devstack sudo[104002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:17 devstack sudo[104002]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.234s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:17 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:17 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager._thread_info {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:15:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread count: 29 {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:15:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread info: [<_MainThread(MainThread, started 128688016527488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:15:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-3e473839-85d2-4a21-9257-f5267286473a req-dc7de1eb-e49c-4688-99bb-d62035e73e64 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-3e473839-85d2-4a21-9257-f5267286473a req-dc7de1eb-e49c-4688-99bb-d62035e73e64 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-3e473839-85d2-4a21-9257-f5267286473a req-dc7de1eb-e49c-4688-99bb-d62035e73e64 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:22 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-3e473839-85d2-4a21-9257-f5267286473a req-dc7de1eb-e49c-4688-99bb-d62035e73e64 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb', 'name': 'volume-c584228b-ccf6-4023-8f2a-0c79758d3429', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3fc4e1d4-dcb1-4995-981d-1553c816554e', 'enforce_multipath': True} {{(pid=87128) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:15:22 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-3e473839-85d2-4a21-9257-f5267286473a req-dc7de1eb-e49c-4688-99bb-d62035e73e64 tempest-TestServerVolumeAttachmentScenario-1900475405 None] attachment_update completed successfully. Sep 01 02:15:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-d2860a47-a241-476c-ac76-a4cee44725d0 req-93ecb600-bb19-4b21-a2a7-2c1f95d2b5c8 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-d2860a47-a241-476c-ac76-a4cee44725d0 req-93ecb600-bb19-4b21-a2a7-2c1f95d2b5c8 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [req-d2860a47-a241-476c-ac76-a4cee44725d0 req-93ecb600-bb19-4b21-a2a7-2c1f95d2b5c8 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-d2860a47-a241-476c-ac76-a4cee44725d0 req-93ecb600-bb19-4b21-a2a7-2c1f95d2b5c8 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb', 'name': 'volume-b682c0c3-e0f8-415c-a8e4-11b11d9b4ab5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf535880-bc87-4c31-8a7c-8246a21fd0e0', 'enforce_multipath': True} {{(pid=87128) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:15:25 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-d2860a47-a241-476c-ac76-a4cee44725d0 req-93ecb600-bb19-4b21-a2a7-2c1f95d2b5c8 tempest-TestServerVolumeAttachmentScenario-1900475405 None] attachment_update completed successfully. Sep 01 02:15:27 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-1645c0fd-589f-4312-85a2-1f6cadef4f4c req-cca31ba9-68a6-4047-b179-1dbccb39a8ce tempest-TestServerVolumeAttachmentScenario-1900475405 None] Terminate volume connection completed successfully. Sep 01 02:15:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-1645c0fd-589f-4312-85a2-1f6cadef4f4c req-cca31ba9-68a6-4047-b179-1dbccb39a8ce tempest-TestServerVolumeAttachmentScenario-1900475405 None] Deleting attachment bf535880-bc87-4c31-8a7c-8246a21fd0e0. {{(pid=87128) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:15:28 devstack cinder-volume[87128]: INFO cinder.volume.manager [req-9659186b-d9fe-4bcc-9498-e630330ffa36 req-2749698c-91c4-4b10-b7cb-d12f5b153af5 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Terminate volume connection completed successfully. Sep 01 02:15:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [req-9659186b-d9fe-4bcc-9498-e630330ffa36 req-2749698c-91c4-4b10-b7cb-d12f5b153af5 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Deleting attachment 3fc4e1d4-dcb1-4995-981d-1553c816554e. {{(pid=87128) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:15:33 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6cc7a5fa-d345-4d73-b4e3-dc80c37a13bc tempest-TestServerVolumeAttachmentScenario-1900475405 None] Acquiring lock "cinder-b682c0c3-e0f8-415c-a8e4-11b11d9b4ab5-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:33 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6cc7a5fa-d345-4d73-b4e3-dc80c37a13bc tempest-TestServerVolumeAttachmentScenario-1900475405 None] Lock "cinder-b682c0c3-e0f8-415c-a8e4-11b11d9b4ab5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:33 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6cc7a5fa-d345-4d73-b4e3-dc80c37a13bc tempest-TestServerVolumeAttachmentScenario-1900475405 None] Acquiring lock "cinder-quobyte-b682c0c3-e0f8-415c-a8e4-11b11d9b4ab5" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:33 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6cc7a5fa-d345-4d73-b4e3-dc80c37a13bc tempest-TestServerVolumeAttachmentScenario-1900475405 None] Lock "cinder-quobyte-b682c0c3-e0f8-415c-a8e4-11b11d9b4ab5" acquired by "delete_volume" :: waited 0.024s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:33 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7242df9-d7c8-424d-93fe-0763724e7b16]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6cc7a5fa-d345-4d73-b4e3-dc80c37a13bc tempest-TestServerVolumeAttachmentScenario-1900475405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b682c0c3-e0f8-415c-a8e4-11b11d9b4ab5 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:33 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b682c0c3-e0f8-415c-a8e4-11b11d9b4ab5 Sep 01 02:15:33 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:33 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6cc7a5fa-d345-4d73-b4e3-dc80c37a13bc tempest-TestServerVolumeAttachmentScenario-1900475405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b682c0c3-e0f8-415c-a8e4-11b11d9b4ab5" returned: 0 in 0.392s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6cc7a5fa-d345-4d73-b4e3-dc80c37a13bc tempest-TestServerVolumeAttachmentScenario-1900475405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b682c0c3-e0f8-415c-a8e4-11b11d9b4ab5 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:33 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b682c0c3-e0f8-415c-a8e4-11b11d9b4ab5 Sep 01 02:15:33 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:34 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6cc7a5fa-d345-4d73-b4e3-dc80c37a13bc tempest-TestServerVolumeAttachmentScenario-1900475405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b682c0c3-e0f8-415c-a8e4-11b11d9b4ab5" returned: 0 in 0.267s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6cc7a5fa-d345-4d73-b4e3-dc80c37a13bc tempest-TestServerVolumeAttachmentScenario-1900475405 None] Lock "cinder-quobyte-b682c0c3-e0f8-415c-a8e4-11b11d9b4ab5" released by "delete_volume" :: held 0.706s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:34 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-6cc7a5fa-d345-4d73-b4e3-dc80c37a13bc tempest-TestServerVolumeAttachmentScenario-1900475405 None] Created reservations ['fd46fd47-1c00-4079-a9f0-09197b49f0da', '7b50fd49-7994-4633-89a7-52ea7aff4916', '63658897-3adf-4b9a-92eb-36768334521a', '171ebdbb-71d0-48f3-9df0-1f7a4c8ec71d'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6cc7a5fa-d345-4d73-b4e3-dc80c37a13bc tempest-TestServerVolumeAttachmentScenario-1900475405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6cc7a5fa-d345-4d73-b4e3-dc80c37a13bc tempest-TestServerVolumeAttachmentScenario-1900475405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:34 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-6cc7a5fa-d345-4d73-b4e3-dc80c37a13bc tempest-TestServerVolumeAttachmentScenario-1900475405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:34 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-6cc7a5fa-d345-4d73-b4e3-dc80c37a13bc tempest-TestServerVolumeAttachmentScenario-1900475405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6cc7a5fa-d345-4d73-b4e3-dc80c37a13bc tempest-TestServerVolumeAttachmentScenario-1900475405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6cc7a5fa-d345-4d73-b4e3-dc80c37a13bc tempest-TestServerVolumeAttachmentScenario-1900475405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:34 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:15:34 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:34 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6cc7a5fa-d345-4d73-b4e3-dc80c37a13bc tempest-TestServerVolumeAttachmentScenario-1900475405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.273s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:34 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-6cc7a5fa-d345-4d73-b4e3-dc80c37a13bc tempest-TestServerVolumeAttachmentScenario-1900475405 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:34 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-6cc7a5fa-d345-4d73-b4e3-dc80c37a13bc tempest-TestServerVolumeAttachmentScenario-1900475405 None] Deleted volume successfully. Sep 01 02:15:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-635fed97-a654-4e9b-b329-395ffc061d29 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Acquiring lock "cinder-c584228b-ccf6-4023-8f2a-0c79758d3429-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-635fed97-a654-4e9b-b329-395ffc061d29 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Lock "cinder-c584228b-ccf6-4023-8f2a-0c79758d3429-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6cc7a5fa-d345-4d73-b4e3-dc80c37a13bc tempest-TestServerVolumeAttachmentScenario-1900475405 None] Lock "cinder-b682c0c3-e0f8-415c-a8e4-11b11d9b4ab5-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-635fed97-a654-4e9b-b329-395ffc061d29 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Acquiring lock "cinder-quobyte-c584228b-ccf6-4023-8f2a-0c79758d3429" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-635fed97-a654-4e9b-b329-395ffc061d29 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Lock "cinder-quobyte-c584228b-ccf6-4023-8f2a-0c79758d3429" acquired by "delete_volume" :: waited 0.014s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:34 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[3790943f-2959-46b4-ab08-4ebbdef0e8e3]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-635fed97-a654-4e9b-b329-395ffc061d29 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c584228b-ccf6-4023-8f2a-0c79758d3429 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:34 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c584228b-ccf6-4023-8f2a-0c79758d3429 Sep 01 02:15:34 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:35 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-635fed97-a654-4e9b-b329-395ffc061d29 tempest-TestServerVolumeAttachmentScenario-1900475405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c584228b-ccf6-4023-8f2a-0c79758d3429" returned: 0 in 0.350s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-635fed97-a654-4e9b-b329-395ffc061d29 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c584228b-ccf6-4023-8f2a-0c79758d3429 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:35 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c584228b-ccf6-4023-8f2a-0c79758d3429 Sep 01 02:15:35 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:35 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-635fed97-a654-4e9b-b329-395ffc061d29 tempest-TestServerVolumeAttachmentScenario-1900475405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c584228b-ccf6-4023-8f2a-0c79758d3429" returned: 0 in 0.250s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-635fed97-a654-4e9b-b329-395ffc061d29 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Lock "cinder-quobyte-c584228b-ccf6-4023-8f2a-0c79758d3429" released by "delete_volume" :: held 0.637s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:35 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-635fed97-a654-4e9b-b329-395ffc061d29 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Created reservations ['bf473716-bea7-4041-86da-3180f92fdd87', '74c31609-02a9-4ed5-8b8c-08ca7497643b', 'cc5b7fc8-0d56-4630-b3ba-2a573ff55c05', '96dcf1ec-af54-41f4-82fb-fd72a3fb2eca'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-635fed97-a654-4e9b-b329-395ffc061d29 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-635fed97-a654-4e9b-b329-395ffc061d29 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:35 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-635fed97-a654-4e9b-b329-395ffc061d29 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:35 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-635fed97-a654-4e9b-b329-395ffc061d29 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-635fed97-a654-4e9b-b329-395ffc061d29 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-635fed97-a654-4e9b-b329-395ffc061d29 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:35 devstack sudo[104532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:15:35 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:35 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-635fed97-a654-4e9b-b329-395ffc061d29 tempest-TestServerVolumeAttachmentScenario-1900475405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.268s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:35 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-635fed97-a654-4e9b-b329-395ffc061d29 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:35 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-635fed97-a654-4e9b-b329-395ffc061d29 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Deleted volume successfully. Sep 01 02:15:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-635fed97-a654-4e9b-b329-395ffc061d29 tempest-TestServerVolumeAttachmentScenario-1900475405 None] Lock "cinder-c584228b-ccf6-4023-8f2a-0c79758d3429-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:45 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=25,cinder:UPDATE=19,cinder:INSERT=5 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:15:45 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=25,cinder:UPDATE=19,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:16:06 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:16:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] Flow 'volume_create_manager' (10238378-3d8e-4e13-a7f1-a7b708e74908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37164bc6-94dc-4a66-b5ec-5885a2c7d1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37164bc6-94dc-4a66-b5ec-5885a2c7d1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-429785296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb872c4c208b4de2acad9701569e8528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:06Z,use_quota=True,user_id='3501f6294f7b4cd8ae498752a1d3fa6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (006a7bff-8365-425d-922a-06d11e3ed0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (006a7bff-8365-425d-922a-06d11e3ed0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dc4f1c7-0c5f-4fa5-b022-dd4f890fac97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dc4f1c7-0c5f-4fa5-b022-dd4f890fac97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f', 'volume_name': 'volume-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9c319d-6d55-446d-b60c-9843a4e07190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9c319d-6d55-446d-b60c-9843a4e07190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f77eb81-8dd9-456d-ab68-3d460d950935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:06 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] Volume 5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f', 'volume_size': 1} Sep 01 02:16:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:06 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-429785296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb872c4c208b4de2acad9701569e8528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:06Z,use_quota=True,user_id='3501f6294f7b4cd8ae498752a1d3fa6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:16:06 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] Creating volume 5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:16:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:06 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:06 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:06 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:16:06 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:16:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:06 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f 1073741824 Sep 01 02:16:06 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:06 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f 1073741824" returned: 0 in 0.409s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:06 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f Sep 01 02:16:06 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:07 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f" returned: 0 in 0.238s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:07 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:16:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f77eb81-8dd9-456d-ab68-3d460d950935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (add5b3c1-d8ab-4d5a-95be-f2508208692b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:07 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] Volume volume-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f (5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f): created successfully Sep 01 02:16:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (add5b3c1-d8ab-4d5a-95be-f2508208692b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] Flow 'volume_create_manager' (10238378-3d8e-4e13-a7f1-a7b708e74908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:07 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-30ab69cd-5999-432c-af9e-71df18023d60 tempest-TestImageHashVerification-668459957 None] Created volume successfully. Sep 01 02:16:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-03daf994-c96c-4c2d-a853-c018c628833c tempest-TestImageHashVerification-668459957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-03daf994-c96c-4c2d-a853-c018c628833c tempest-TestImageHashVerification-668459957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:08 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6f75f0-b67a-4e67-b840-4b538992a5ba]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-03daf994-c96c-4c2d-a853-c018c628833c tempest-TestImageHashVerification-668459957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:08 devstack sudo[104555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f Sep 01 02:16:08 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:08 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-03daf994-c96c-4c2d-a853-c018c628833c tempest-TestImageHashVerification-668459957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f" returned: 0 in 0.357s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:08 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[326419ce-9127-4818-bbec-b342cdda2e4c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-03daf994-c96c-4c2d-a853-c018c628833c tempest-TestImageHashVerification-668459957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:08 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f Sep 01 02:16:08 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:08 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-03daf994-c96c-4c2d-a853-c018c628833c tempest-TestImageHashVerification-668459957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f" returned: 0 in 0.377s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-03daf994-c96c-4c2d-a853-c018c628833c tempest-TestImageHashVerification-668459957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f /opt/stack/data/cinder/conversion/5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f.temp_image.82ae4c22-a377-4b29-ad79-666d14951dafa349w6oi.img {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:08 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f /opt/stack/data/cinder/conversion/5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f.temp_image.82ae4c22-a377-4b29-ad79-666d14951dafa349w6oi.img Sep 01 02:16:08 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:12 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-03daf994-c96c-4c2d-a853-c018c628833c tempest-TestImageHashVerification-668459957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f /opt/stack/data/cinder/conversion/5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f.temp_image.82ae4c22-a377-4b29-ad79-666d14951dafa349w6oi.img" returned: 0 in 3.569s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:12 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f4eae1-d6e4-4c58-bc50-a04d0894f220]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-03daf994-c96c-4c2d-a853-c018c628833c tempest-TestImageHashVerification-668459957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:12 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f Sep 01 02:16:12 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:12 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-03daf994-c96c-4c2d-a853-c018c628833c tempest-TestImageHashVerification-668459957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f" returned: 0 in 0.499s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:12 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-03daf994-c96c-4c2d-a853-c018c628833c tempest-TestImageHashVerification-668459957 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f, size 1024.00 MB, duration 3.57 sec, destination /opt/stack/data/cinder/conversion/5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f.temp_image.82ae4c22-a377-4b29-ad79-666d14951dafa349w6oi.img {{(pid=87128) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:16:12 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-03daf994-c96c-4c2d-a853-c018c628833c tempest-TestImageHashVerification-668459957 None] Converted 1024.00 MB image at 286.86 MB/s Sep 01 02:16:12 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-03daf994-c96c-4c2d-a853-c018c628833c tempest-TestImageHashVerification-668459957 None] 82ae4c22-a377-4b29-ad79-666d14951daf was raw, no need to convert to raw {{(pid=87128) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 01 02:16:16 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:16:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:17 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:16:17 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:17 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.246s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:17 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:16:17 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager._thread_info {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:16:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread count: 29 {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:16:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread info: [<_MainThread(MainThread, started 128688016527488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:16:22 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:UPDATE=3,cinder:SELECT=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:16:22 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:16:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-03daf994-c96c-4c2d-a853-c018c628833c tempest-TestImageHashVerification-668459957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 23.401s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-03daf994-c96c-4c2d-a853-c018c628833c tempest-TestImageHashVerification-668459957 None] Uploaded volume to glance image-id: 82ae4c22-a377-4b29-ad79-666d14951daf. {{(pid=87128) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 02:16:31 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-03daf994-c96c-4c2d-a853-c018c628833c tempest-TestImageHashVerification-668459957 None] Copy volume to image completed successfully. Sep 01 02:16:32 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-19261157-09a1-4205-be06-90912781b937 tempest-TestImageHashVerification-668459957 None] Acquiring lock "cinder-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:32 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-19261157-09a1-4205-be06-90912781b937 tempest-TestImageHashVerification-668459957 None] Lock "cinder-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:32 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-19261157-09a1-4205-be06-90912781b937 tempest-TestImageHashVerification-668459957 None] Acquiring lock "cinder-quobyte-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:32 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-19261157-09a1-4205-be06-90912781b937 tempest-TestImageHashVerification-668459957 None] Lock "cinder-quobyte-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f" acquired by "delete_volume" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:32 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebe0dfd-5bd7-4812-87b4-bab2f50120c5]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-19261157-09a1-4205-be06-90912781b937 tempest-TestImageHashVerification-668459957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:32 devstack sudo[104634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f Sep 01 02:16:32 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:32 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-19261157-09a1-4205-be06-90912781b937 tempest-TestImageHashVerification-668459957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f" returned: 0 in 0.364s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-19261157-09a1-4205-be06-90912781b937 tempest-TestImageHashVerification-668459957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:32 devstack sudo[104639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f Sep 01 02:16:32 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:33 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-19261157-09a1-4205-be06-90912781b937 tempest-TestImageHashVerification-668459957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f" returned: 0 in 0.241s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:33 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-19261157-09a1-4205-be06-90912781b937 tempest-TestImageHashVerification-668459957 None] Lock "cinder-quobyte-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f" released by "delete_volume" :: held 0.644s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:33 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-19261157-09a1-4205-be06-90912781b937 tempest-TestImageHashVerification-668459957 None] Created reservations ['38ee3ef9-e099-408a-aa9a-cc51db222de4', '291d2562-32d7-4fe4-90d3-ef6a0052d6f3', '6c113945-4386-4476-a711-aaaa85893c0f', 'ab2ebbee-09b8-44a0-b4af-7a31e1bd87dd'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-19261157-09a1-4205-be06-90912781b937 tempest-TestImageHashVerification-668459957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-19261157-09a1-4205-be06-90912781b937 tempest-TestImageHashVerification-668459957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-19261157-09a1-4205-be06-90912781b937 tempest-TestImageHashVerification-668459957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-19261157-09a1-4205-be06-90912781b937 tempest-TestImageHashVerification-668459957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-19261157-09a1-4205-be06-90912781b937 tempest-TestImageHashVerification-668459957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-19261157-09a1-4205-be06-90912781b937 tempest-TestImageHashVerification-668459957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:33 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:16:33 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:33 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-19261157-09a1-4205-be06-90912781b937 tempest-TestImageHashVerification-668459957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.230s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:33 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-19261157-09a1-4205-be06-90912781b937 tempest-TestImageHashVerification-668459957 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:16:33 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-19261157-09a1-4205-be06-90912781b937 tempest-TestImageHashVerification-668459957 None] Deleted volume successfully. Sep 01 02:16:33 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-19261157-09a1-4205-be06-90912781b937 tempest-TestImageHashVerification-668459957 None] Lock "cinder-5a2fc8ad-0c77-4c13-bbdd-7bae9233b96f-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:43 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:16:43 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=11 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:16:44 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:16:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] Flow 'volume_create_manager' (f0fa85c4-922a-405b-9ccd-c039daf365db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (261a4e8d-c153-48c7-834c-578688ef2162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (261a4e8d-c153-48c7-834c-578688ef2162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc1238d-39c2-47d2-94c8-43936d7c6fff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f29e59a164e64309a0b8a2d4e30bee4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:45Z,use_quota=True,user_id='527c9872e0014f1bb318fb3957fda232',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5b19156-655a-48df-a42e-3eb1befae2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5b19156-655a-48df-a42e-3eb1befae2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61f49d4c-ef23-4955-a19b-d7c96a4683cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61f49d4c-ef23-4955-a19b-d7c96a4683cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdc1238d-39c2-47d2-94c8-43936d7c6fff', 'volume_name': 'volume-bdc1238d-39c2-47d2-94c8-43936d7c6fff', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f9b761-fdde-4a0c-8c64-d35cadd77fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f9b761-fdde-4a0c-8c64-d35cadd77fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:44 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc93ff16-a784-42ff-8b57-013998410b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:44 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] Volume bdc1238d-39c2-47d2-94c8-43936d7c6fff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdc1238d-39c2-47d2-94c8-43936d7c6fff', 'volume_size': 1} Sep 01 02:16:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:44 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc1238d-39c2-47d2-94c8-43936d7c6fff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f29e59a164e64309a0b8a2d4e30bee4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:45Z,use_quota=True,user_id='527c9872e0014f1bb318fb3957fda232',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:16:44 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] Creating volume bdc1238d-39c2-47d2-94c8-43936d7c6fff {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:16:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:44 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:44 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:44 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:16:44 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:16:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bdc1238d-39c2-47d2-94c8-43936d7c6fff 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:44 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bdc1238d-39c2-47d2-94c8-43936d7c6fff 1073741824 Sep 01 02:16:44 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:45 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bdc1238d-39c2-47d2-94c8-43936d7c6fff 1073741824" returned: 0 in 0.430s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bdc1238d-39c2-47d2-94c8-43936d7c6fff {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:45 devstack sudo[104658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bdc1238d-39c2-47d2-94c8-43936d7c6fff Sep 01 02:16:45 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:45 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bdc1238d-39c2-47d2-94c8-43936d7c6fff" returned: 0 in 0.257s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:45 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:16:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:45 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc93ff16-a784-42ff-8b57-013998410b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdc1238d-39c2-47d2-94c8-43936d7c6fff', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:45 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79994769-1864-4abe-93e5-b880dd3668c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:45 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] Volume volume-bdc1238d-39c2-47d2-94c8-43936d7c6fff (bdc1238d-39c2-47d2-94c8-43936d7c6fff): created successfully Sep 01 02:16:45 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79994769-1864-4abe-93e5-b880dd3668c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:45 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] Flow 'volume_create_manager' (f0fa85c4-922a-405b-9ccd-c039daf365db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:45 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-b398e270-37f1-4dc6-9061-133937875757 tempest-CinderUnicodeTest-1397505449 None] Created volume successfully. Sep 01 02:16:46 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:16:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] Flow 'volume_create_manager' (dd36dc4c-1ede-4537-b44d-942f1ae95698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ed6294-1f9a-4b48-9c61-68d5675aa573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ed6294-1f9a-4b48-9c61-68d5675aa573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2122738346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9f0c7e6-004c-4071-802e-7e5b9ab850b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f29e59a164e64309a0b8a2d4e30bee4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:46Z,use_quota=True,user_id='527c9872e0014f1bb318fb3957fda232',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c571adb-2ddd-40ea-9ac2-c8661083a77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c571adb-2ddd-40ea-9ac2-c8661083a77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30dbee3f-c9c2-4eac-8de7-d54c9f03fd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30dbee3f-c9c2-4eac-8de7-d54c9f03fd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9f0c7e6-004c-4071-802e-7e5b9ab850b4', 'volume_name': 'volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b32e4f7-b9e4-4f97-a484-0669fabb1b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b32e4f7-b9e4-4f97-a484-0669fabb1b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (556b1502-29f0-49b0-88c5-85fa1cf57d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:46 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] Volume b9f0c7e6-004c-4071-802e-7e5b9ab850b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4', 'volume_size': 1} Sep 01 02:16:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2122738346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9f0c7e6-004c-4071-802e-7e5b9ab850b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f29e59a164e64309a0b8a2d4e30bee4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:46Z,use_quota=True,user_id='527c9872e0014f1bb318fb3957fda232',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:16:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] Creating volume b9f0c7e6-004c-4071-802e-7e5b9ab850b4 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:16:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:16:46 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:16:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:46 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4 1073741824 Sep 01 02:16:46 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:46 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4 1073741824" returned: 0 in 0.427s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:46 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4 Sep 01 02:16:46 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:46 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4" returned: 0 in 0.249s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:16:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (556b1502-29f0-49b0-88c5-85fa1cf57d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d06d00ab-d341-4714-9742-34c3677020fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:47 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] Volume volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4 (b9f0c7e6-004c-4071-802e-7e5b9ab850b4): created successfully Sep 01 02:16:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d06d00ab-d341-4714-9742-34c3677020fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] Flow 'volume_create_manager' (dd36dc4c-1ede-4537-b44d-942f1ae95698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:47 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-31ea72c6-90ee-4f9b-95de-75b666dc5f66 tempest-CinderUnicodeTest-1397505449 None] Created volume successfully. Sep 01 02:16:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9dffa899-6941-4d11-acfe-cc20bed3df67 tempest-CinderUnicodeTest-1397505449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9dffa899-6941-4d11-acfe-cc20bed3df67 tempest-CinderUnicodeTest-1397505449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:47 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-9dffa899-6941-4d11-acfe-cc20bed3df67 tempest-CinderUnicodeTest-1397505449 None] Creating offline snapshot 9f1da4b3-9411-4398-9be4-7605107da468 of volume b9f0c7e6-004c-4071-802e-7e5b9ab850b4 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:16:47 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3896ae2-5ee3-4fd6-a1cb-9479cbecc9dd]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9dffa899-6941-4d11-acfe-cc20bed3df67 tempest-CinderUnicodeTest-1397505449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:47 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4 Sep 01 02:16:47 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:47 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9dffa899-6941-4d11-acfe-cc20bed3df67 tempest-CinderUnicodeTest-1397505449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4" returned: 0 in 0.370s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9dffa899-6941-4d11-acfe-cc20bed3df67 tempest-CinderUnicodeTest-1397505449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4.9f1da4b3-9411-4398-9be4-7605107da468 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:47 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4.9f1da4b3-9411-4398-9be4-7605107da468 1G Sep 01 02:16:47 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:48 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9dffa899-6941-4d11-acfe-cc20bed3df67 tempest-CinderUnicodeTest-1397505449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4.9f1da4b3-9411-4398-9be4-7605107da468 1G" returned: 0 in 0.375s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9dffa899-6941-4d11-acfe-cc20bed3df67 tempest-CinderUnicodeTest-1397505449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4.9f1da4b3-9411-4398-9be4-7605107da468 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:48 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4.9f1da4b3-9411-4398-9be4-7605107da468 Sep 01 02:16:48 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:48 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9dffa899-6941-4d11-acfe-cc20bed3df67 tempest-CinderUnicodeTest-1397505449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4.9f1da4b3-9411-4398-9be4-7605107da468" returned: 0 in 0.279s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:48 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-9dffa899-6941-4d11-acfe-cc20bed3df67 tempest-CinderUnicodeTest-1397505449 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4.9f1da4b3-9411-4398-9be4-7605107da468 is being set with open permissions: ugo+rw Sep 01 02:16:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9dffa899-6941-4d11-acfe-cc20bed3df67 tempest-CinderUnicodeTest-1397505449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4.9f1da4b3-9411-4398-9be4-7605107da468 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:48 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4.9f1da4b3-9411-4398-9be4-7605107da468 Sep 01 02:16:48 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:48 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9dffa899-6941-4d11-acfe-cc20bed3df67 tempest-CinderUnicodeTest-1397505449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4.9f1da4b3-9411-4398-9be4-7605107da468" returned: 0 in 0.230s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9dffa899-6941-4d11-acfe-cc20bed3df67 tempest-CinderUnicodeTest-1397505449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:48 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4.info Sep 01 02:16:48 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:48 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9dffa899-6941-4d11-acfe-cc20bed3df67 tempest-CinderUnicodeTest-1397505449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4.info" returned: 0 in 0.239s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:48 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-9dffa899-6941-4d11-acfe-cc20bed3df67 tempest-CinderUnicodeTest-1397505449 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4.info is being set with open permissions: ugo+rw Sep 01 02:16:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9dffa899-6941-4d11-acfe-cc20bed3df67 tempest-CinderUnicodeTest-1397505449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:48 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4.info Sep 01 02:16:48 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:49 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9dffa899-6941-4d11-acfe-cc20bed3df67 tempest-CinderUnicodeTest-1397505449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4.info" returned: 0 in 0.258s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9dffa899-6941-4d11-acfe-cc20bed3df67 tempest-CinderUnicodeTest-1397505449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.836s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:49 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-9dffa899-6941-4d11-acfe-cc20bed3df67 tempest-CinderUnicodeTest-1397505449 None] Create snapshot completed successfully Sep 01 02:16:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-631e6088-b506-4d30-8b6a-d2a7b09fea5d tempest-CinderUnicodeTest-1397505449 None] Acquiring lock "cinder-9f1da4b3-9411-4398-9be4-7605107da468-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-631e6088-b506-4d30-8b6a-d2a7b09fea5d tempest-CinderUnicodeTest-1397505449 None] Lock "cinder-9f1da4b3-9411-4398-9be4-7605107da468-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-631e6088-b506-4d30-8b6a-d2a7b09fea5d tempest-CinderUnicodeTest-1397505449 None] Acquiring lock "cinder-quobyte-b9f0c7e6-004c-4071-802e-7e5b9ab850b4" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-631e6088-b506-4d30-8b6a-d2a7b09fea5d tempest-CinderUnicodeTest-1397505449 None] Lock "cinder-quobyte-b9f0c7e6-004c-4071-802e-7e5b9ab850b4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-631e6088-b506-4d30-8b6a-d2a7b09fea5d tempest-CinderUnicodeTest-1397505449 None] Acquiring lock "cinder-quobyte-9f1da4b3-9411-4398-9be4-7605107da468" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-631e6088-b506-4d30-8b6a-d2a7b09fea5d tempest-CinderUnicodeTest-1397505449 None] Lock "cinder-quobyte-9f1da4b3-9411-4398-9be4-7605107da468" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-631e6088-b506-4d30-8b6a-d2a7b09fea5d tempest-CinderUnicodeTest-1397505449 None] Deleting offline snapshot 9f1da4b3-9411-4398-9be4-7605107da468 of volume b9f0c7e6-004c-4071-802e-7e5b9ab850b4 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:16:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-631e6088-b506-4d30-8b6a-d2a7b09fea5d tempest-CinderUnicodeTest-1397505449 None] snapshot_file for this snap is: volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4.9f1da4b3-9411-4398-9be4-7605107da468 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:16:49 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b111c0f-6ac9-404c-a70e-04cec5649627]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-631e6088-b506-4d30-8b6a-d2a7b09fea5d tempest-CinderUnicodeTest-1397505449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4.9f1da4b3-9411-4398-9be4-7605107da468 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:49 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4.9f1da4b3-9411-4398-9be4-7605107da468 Sep 01 02:16:49 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:49 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-631e6088-b506-4d30-8b6a-d2a7b09fea5d tempest-CinderUnicodeTest-1397505449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4.9f1da4b3-9411-4398-9be4-7605107da468" returned: 0 in 0.337s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-631e6088-b506-4d30-8b6a-d2a7b09fea5d tempest-CinderUnicodeTest-1397505449 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:16:49 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3d1702-4757-44dd-8cbe-8288b6c55422]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-631e6088-b506-4d30-8b6a-d2a7b09fea5d tempest-CinderUnicodeTest-1397505449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:50 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4 Sep 01 02:16:50 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:50 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-631e6088-b506-4d30-8b6a-d2a7b09fea5d tempest-CinderUnicodeTest-1397505449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4" returned: 0 in 0.341s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-631e6088-b506-4d30-8b6a-d2a7b09fea5d tempest-CinderUnicodeTest-1397505449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4.9f1da4b3-9411-4398-9be4-7605107da468 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:50 devstack sudo[104704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4.9f1da4b3-9411-4398-9be4-7605107da468 Sep 01 02:16:50 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:50 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-631e6088-b506-4d30-8b6a-d2a7b09fea5d tempest-CinderUnicodeTest-1397505449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4.9f1da4b3-9411-4398-9be4-7605107da468" returned: 0 in 0.314s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-631e6088-b506-4d30-8b6a-d2a7b09fea5d tempest-CinderUnicodeTest-1397505449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4.9f1da4b3-9411-4398-9be4-7605107da468 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:50 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4.9f1da4b3-9411-4398-9be4-7605107da468 Sep 01 02:16:50 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:50 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-631e6088-b506-4d30-8b6a-d2a7b09fea5d tempest-CinderUnicodeTest-1397505449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4.9f1da4b3-9411-4398-9be4-7605107da468" returned: 0 in 0.226s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-631e6088-b506-4d30-8b6a-d2a7b09fea5d tempest-CinderUnicodeTest-1397505449 None] Lock "cinder-quobyte-9f1da4b3-9411-4398-9be4-7605107da468" released by "_delete_snapshot" :: held 1.312s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-631e6088-b506-4d30-8b6a-d2a7b09fea5d tempest-CinderUnicodeTest-1397505449 None] Lock "cinder-quobyte-b9f0c7e6-004c-4071-802e-7e5b9ab850b4" released by "delete_snapshot" :: held 1.332s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:50 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-631e6088-b506-4d30-8b6a-d2a7b09fea5d tempest-CinderUnicodeTest-1397505449 None] Created reservations ['0177611b-527d-484a-b6f1-64a900557db7', '139be44b-32e9-49a5-b381-d827d77b4754', '97cc00e0-959c-4e3d-be22-3504da6b757a', '2f6d1f9d-51f1-466e-90d2-f5ce0143afeb'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:51 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-631e6088-b506-4d30-8b6a-d2a7b09fea5d tempest-CinderUnicodeTest-1397505449 None] Delete snapshot completed successfully. Sep 01 02:16:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-631e6088-b506-4d30-8b6a-d2a7b09fea5d tempest-CinderUnicodeTest-1397505449 None] Lock "cinder-9f1da4b3-9411-4398-9be4-7605107da468-delete_snapshot" released by "delete_snapshot" :: held 1.460s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3ef0848c-9d4e-413e-bd2e-022479111d42 tempest-CinderUnicodeTest-1397505449 None] Acquiring lock "cinder-b9f0c7e6-004c-4071-802e-7e5b9ab850b4-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3ef0848c-9d4e-413e-bd2e-022479111d42 tempest-CinderUnicodeTest-1397505449 None] Lock "cinder-b9f0c7e6-004c-4071-802e-7e5b9ab850b4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3ef0848c-9d4e-413e-bd2e-022479111d42 tempest-CinderUnicodeTest-1397505449 None] Acquiring lock "cinder-quobyte-b9f0c7e6-004c-4071-802e-7e5b9ab850b4" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3ef0848c-9d4e-413e-bd2e-022479111d42 tempest-CinderUnicodeTest-1397505449 None] Lock "cinder-quobyte-b9f0c7e6-004c-4071-802e-7e5b9ab850b4" acquired by "delete_volume" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:51 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0c4926-e248-498a-b910-4224dd079e44]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3ef0848c-9d4e-413e-bd2e-022479111d42 tempest-CinderUnicodeTest-1397505449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:51 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4 Sep 01 02:16:51 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:52 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3ef0848c-9d4e-413e-bd2e-022479111d42 tempest-CinderUnicodeTest-1397505449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4" returned: 0 in 0.337s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3ef0848c-9d4e-413e-bd2e-022479111d42 tempest-CinderUnicodeTest-1397505449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:52 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4 Sep 01 02:16:52 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:52 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3ef0848c-9d4e-413e-bd2e-022479111d42 tempest-CinderUnicodeTest-1397505449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-b9f0c7e6-004c-4071-802e-7e5b9ab850b4" returned: 0 in 0.236s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3ef0848c-9d4e-413e-bd2e-022479111d42 tempest-CinderUnicodeTest-1397505449 None] Lock "cinder-quobyte-b9f0c7e6-004c-4071-802e-7e5b9ab850b4" released by "delete_volume" :: held 0.626s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:52 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-3ef0848c-9d4e-413e-bd2e-022479111d42 tempest-CinderUnicodeTest-1397505449 None] Created reservations ['0168dbe8-a2e9-4cf6-bb81-a962afc3f29b', '1e9246aa-ddc6-47dd-abdf-8ea7f3466bb4', 'd16dc458-ed25-4a67-8b9a-1ab55ea11285', 'be668aff-0e14-4816-b9ee-81b3b7f23f50'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3ef0848c-9d4e-413e-bd2e-022479111d42 tempest-CinderUnicodeTest-1397505449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3ef0848c-9d4e-413e-bd2e-022479111d42 tempest-CinderUnicodeTest-1397505449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:52 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3ef0848c-9d4e-413e-bd2e-022479111d42 tempest-CinderUnicodeTest-1397505449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:52 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3ef0848c-9d4e-413e-bd2e-022479111d42 tempest-CinderUnicodeTest-1397505449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3ef0848c-9d4e-413e-bd2e-022479111d42 tempest-CinderUnicodeTest-1397505449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3ef0848c-9d4e-413e-bd2e-022479111d42 tempest-CinderUnicodeTest-1397505449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:52 devstack sudo[104721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:16:52 devstack sudo[104721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:52 devstack sudo[104721]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3ef0848c-9d4e-413e-bd2e-022479111d42 tempest-CinderUnicodeTest-1397505449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.247s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:52 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-3ef0848c-9d4e-413e-bd2e-022479111d42 tempest-CinderUnicodeTest-1397505449 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:16:52 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-3ef0848c-9d4e-413e-bd2e-022479111d42 tempest-CinderUnicodeTest-1397505449 None] Deleted volume successfully. Sep 01 02:16:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3ef0848c-9d4e-413e-bd2e-022479111d42 tempest-CinderUnicodeTest-1397505449 None] Lock "cinder-b9f0c7e6-004c-4071-802e-7e5b9ab850b4-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-87d0f4d2-9c02-430b-b12c-4b160350c628 tempest-CinderUnicodeTest-1397505449 None] Acquiring lock "cinder-bdc1238d-39c2-47d2-94c8-43936d7c6fff-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-87d0f4d2-9c02-430b-b12c-4b160350c628 tempest-CinderUnicodeTest-1397505449 None] Lock "cinder-bdc1238d-39c2-47d2-94c8-43936d7c6fff-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-87d0f4d2-9c02-430b-b12c-4b160350c628 tempest-CinderUnicodeTest-1397505449 None] Acquiring lock "cinder-quobyte-bdc1238d-39c2-47d2-94c8-43936d7c6fff" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-87d0f4d2-9c02-430b-b12c-4b160350c628 tempest-CinderUnicodeTest-1397505449 None] Lock "cinder-quobyte-bdc1238d-39c2-47d2-94c8-43936d7c6fff" acquired by "delete_volume" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:52 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2043dce-04a5-4ef3-b7a0-be4f57648aa9]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-87d0f4d2-9c02-430b-b12c-4b160350c628 tempest-CinderUnicodeTest-1397505449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bdc1238d-39c2-47d2-94c8-43936d7c6fff {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:53 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bdc1238d-39c2-47d2-94c8-43936d7c6fff Sep 01 02:16:53 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:53 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-87d0f4d2-9c02-430b-b12c-4b160350c628 tempest-CinderUnicodeTest-1397505449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bdc1238d-39c2-47d2-94c8-43936d7c6fff" returned: 0 in 0.350s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-87d0f4d2-9c02-430b-b12c-4b160350c628 tempest-CinderUnicodeTest-1397505449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bdc1238d-39c2-47d2-94c8-43936d7c6fff {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:53 devstack sudo[104729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bdc1238d-39c2-47d2-94c8-43936d7c6fff Sep 01 02:16:53 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:53 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-87d0f4d2-9c02-430b-b12c-4b160350c628 tempest-CinderUnicodeTest-1397505449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bdc1238d-39c2-47d2-94c8-43936d7c6fff" returned: 0 in 0.231s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-87d0f4d2-9c02-430b-b12c-4b160350c628 tempest-CinderUnicodeTest-1397505449 None] Lock "cinder-quobyte-bdc1238d-39c2-47d2-94c8-43936d7c6fff" released by "delete_volume" :: held 0.620s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:53 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-87d0f4d2-9c02-430b-b12c-4b160350c628 tempest-CinderUnicodeTest-1397505449 None] Created reservations ['8dee93a3-4e6a-46a4-869a-7d487da2988f', '5cbeef8c-43fd-4b92-b66f-6d6cad374d2a', 'b701cf1c-e4cc-4826-b82b-98cd65398e3a', '965afa9c-ae5f-4d68-b83e-6e078b6cc5d5'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-87d0f4d2-9c02-430b-b12c-4b160350c628 tempest-CinderUnicodeTest-1397505449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-87d0f4d2-9c02-430b-b12c-4b160350c628 tempest-CinderUnicodeTest-1397505449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-87d0f4d2-9c02-430b-b12c-4b160350c628 tempest-CinderUnicodeTest-1397505449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-87d0f4d2-9c02-430b-b12c-4b160350c628 tempest-CinderUnicodeTest-1397505449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-87d0f4d2-9c02-430b-b12c-4b160350c628 tempest-CinderUnicodeTest-1397505449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-87d0f4d2-9c02-430b-b12c-4b160350c628 tempest-CinderUnicodeTest-1397505449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:53 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:16:53 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:53 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-87d0f4d2-9c02-430b-b12c-4b160350c628 tempest-CinderUnicodeTest-1397505449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.249s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:53 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-87d0f4d2-9c02-430b-b12c-4b160350c628 tempest-CinderUnicodeTest-1397505449 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:16:53 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-87d0f4d2-9c02-430b-b12c-4b160350c628 tempest-CinderUnicodeTest-1397505449 None] Deleted volume successfully. Sep 01 02:16:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-87d0f4d2-9c02-430b-b12c-4b160350c628 tempest-CinderUnicodeTest-1397505449 None] Lock "cinder-bdc1238d-39c2-47d2-94c8-43936d7c6fff-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:03 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=24,cinder:UPDATE=29,cinder:INSERT=9,cinder:DELETE=1 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:17:03 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:UPDATE=29,cinder:SELECT=22,cinder:DELETE=4,cinder:INSERT=6 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] Flow 'volume_create_manager' (b61bac33-0b29-45b8-8ab4-4290f9a46974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc464d1-8d5a-45a5-b750-8a3dc95ae590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc464d1-8d5a-45a5-b750-8a3dc95ae590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1668526558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dacefde0-41a3-4045-9ebf-9375942dd797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d57dc4bed339449680c6390c8ae33f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:15Z,use_quota=True,user_id='e5172b41b3074add9a0f35620b8dc3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef3a770-7b7e-42b5-b70c-104af70fa128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef3a770-7b7e-42b5-b70c-104af70fa128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee421f1-5f85-4a7d-bb5b-edc5e86f22c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee421f1-5f85-4a7d-bb5b-edc5e86f22c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dacefde0-41a3-4045-9ebf-9375942dd797', 'volume_name': 'volume-dacefde0-41a3-4045-9ebf-9375942dd797', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edef43c5-e061-456e-8145-373336ba3aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edef43c5-e061-456e-8145-373336ba3aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57626e03-9968-4f05-9843-e4284f608014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:15 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] Volume dacefde0-41a3-4045-9ebf-9375942dd797: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dacefde0-41a3-4045-9ebf-9375942dd797', 'volume_size': 1} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1668526558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dacefde0-41a3-4045-9ebf-9375942dd797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d57dc4bed339449680c6390c8ae33f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:15Z,use_quota=True,user_id='e5172b41b3074add9a0f35620b8dc3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] Creating volume dacefde0-41a3-4045-9ebf-9375942dd797 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:15 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dacefde0-41a3-4045-9ebf-9375942dd797 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:15 devstack sudo[104777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dacefde0-41a3-4045-9ebf-9375942dd797 1073741824 Sep 01 02:17:15 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Flow 'volume_create_manager' (df389595-8239-45bf-9fd0-24e0976e2547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b68e5edc-ea9d-47fa-b6c2-f465a77682e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b68e5edc-ea9d-47fa-b6c2-f465a77682e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1243664713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a573ffae-eda5-4b45-852a-e301d4ef2a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5234b938adc54c2ba040025e623336b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:15Z,use_quota=True,user_id='b3890c86807148c591b8d9f07cba620c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf3b81a-41fd-4749-8f27-99d4366fd85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf3b81a-41fd-4749-8f27-99d4366fd85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa648a6-1645-4859-8735-b2609c27db6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa648a6-1645-4859-8735-b2609c27db6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a573ffae-eda5-4b45-852a-e301d4ef2a0f', 'volume_name': 'volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (416e8afe-ea14-4bd3-8f57-9633c02eb1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (416e8afe-ea14-4bd3-8f57-9633c02eb1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff83b82b-14e9-465f-86d5-65a42ee6ef38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:15 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Volume a573ffae-eda5-4b45-852a-e301d4ef2a0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f', 'volume_size': 1} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] Flow 'volume_create_manager' (4ddfd94c-c4af-4cff-891e-789d82d66a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d233ac9c-3dfd-4abd-9416-6b4b579266fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d233ac9c-3dfd-4abd-9416-6b4b579266fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1900585837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a282eb4-b662-4557-90b0-1fe78bf60f94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d57dc4bed339449680c6390c8ae33f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:15Z,use_quota=True,user_id='e5172b41b3074add9a0f35620b8dc3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54000980-fb09-42d4-b6ab-373aa4418a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54000980-fb09-42d4-b6ab-373aa4418a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a71fd37-158c-482e-9d35-babc3e8a52a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a71fd37-158c-482e-9d35-babc3e8a52a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a282eb4-b662-4557-90b0-1fe78bf60f94', 'volume_name': 'volume-8a282eb4-b662-4557-90b0-1fe78bf60f94', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f4c4f86-881a-447d-9df9-a47cde92f8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f4c4f86-881a-447d-9df9-a47cde92f8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0712cd18-474f-4513-a65e-da89c4e8c08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:15 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] Volume 8a282eb4-b662-4557-90b0-1fe78bf60f94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a282eb4-b662-4557-90b0-1fe78bf60f94', 'volume_size': 1} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] Flow 'volume_create_manager' (f07ea7c8-d53a-4aa1-b000-3b6e7285f148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a64a84f7-2730-4fb1-bde0-3914a8dd9374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a64a84f7-2730-4fb1-bde0-3914a8dd9374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-778016840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=486fa76f-6456-49af-b05e-18cb35771455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d57dc4bed339449680c6390c8ae33f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:16Z,use_quota=True,user_id='e5172b41b3074add9a0f35620b8dc3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cedb3f80-86ca-4b07-9f9a-f641d598d95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cedb3f80-86ca-4b07-9f9a-f641d598d95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (418d7279-2f44-4613-bb2d-343701ca1f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (418d7279-2f44-4613-bb2d-343701ca1f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '486fa76f-6456-49af-b05e-18cb35771455', 'volume_name': 'volume-486fa76f-6456-49af-b05e-18cb35771455', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (156e00fd-81b2-48e9-820c-ffdca6b52ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (156e00fd-81b2-48e9-820c-ffdca6b52ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ab03885-bbd8-4745-abe9-c0f5c62ddf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:15 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] Volume 486fa76f-6456-49af-b05e-18cb35771455: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-486fa76f-6456-49af-b05e-18cb35771455', 'volume_size': 1} Sep 01 02:17:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:16 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dacefde0-41a3-4045-9ebf-9375942dd797 1073741824" returned: 0 in 0.884s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dacefde0-41a3-4045-9ebf-9375942dd797 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:16 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dacefde0-41a3-4045-9ebf-9375942dd797 Sep 01 02:17:16 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] Flow 'volume_create_manager' (e0b14ecb-c860-4f0c-9c12-a415bfe73078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69610515-555e-4aba-9950-f0415356d08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69610515-555e-4aba-9950-f0415356d08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-82800461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d509d0a4-737f-46d4-abe1-d56619d16e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d57dc4bed339449680c6390c8ae33f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:16Z,use_quota=True,user_id='e5172b41b3074add9a0f35620b8dc3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96f45b5b-6af2-4513-ba39-f61c4759d728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96f45b5b-6af2-4513-ba39-f61c4759d728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e0e839-057d-4d8a-92c8-d922f2c4e244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e0e839-057d-4d8a-92c8-d922f2c4e244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd509d0a4-737f-46d4-abe1-d56619d16e50', 'volume_name': 'volume-d509d0a4-737f-46d4-abe1-d56619d16e50', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe5d86a4-ef22-4be3-b1c5-ffbfa676a3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe5d86a4-ef22-4be3-b1c5-ffbfa676a3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cbaa9ee-f1f1-4576-a740-de9735504ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:16 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] Volume d509d0a4-737f-46d4-abe1-d56619d16e50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d509d0a4-737f-46d4-abe1-d56619d16e50', 'volume_size': 1} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:16 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dacefde0-41a3-4045-9ebf-9375942dd797" returned: 0 in 0.393s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.986s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1243664713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a573ffae-eda5-4b45-852a-e301d4ef2a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5234b938adc54c2ba040025e623336b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:15Z,use_quota=True,user_id='b3890c86807148c591b8d9f07cba620c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Creating volume a573ffae-eda5-4b45-852a-e301d4ef2a0f {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:16 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:16 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f 1073741824 Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57626e03-9968-4f05-9843-e4284f608014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dacefde0-41a3-4045-9ebf-9375942dd797', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6605d2e1-ea22-4f2a-9c4d-cdf2e10e19e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:16 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:16 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] Volume volume-dacefde0-41a3-4045-9ebf-9375942dd797 (dacefde0-41a3-4045-9ebf-9375942dd797): created successfully Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6605d2e1-ea22-4f2a-9c4d-cdf2e10e19e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] Flow 'volume_create_manager' (b61bac33-0b29-45b8-8ab4-4290f9a46974) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:16 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-5dabbd8d-a33a-4a11-ab30-255602e8a5bb tempest-CreateVolumesFromImageTest-2095848695 None] Created volume successfully. Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] Flow 'volume_create_manager' (71d1f901-3f85-4b87-b7cc-4dd6811aeb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d6029a-bc34-4d85-ba5d-0a51221203f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d6029a-bc34-4d85-ba5d-0a51221203f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1703377648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=928f889f-97d4-411a-9562-9c8476b7f17f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d57dc4bed339449680c6390c8ae33f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:17Z,use_quota=True,user_id='e5172b41b3074add9a0f35620b8dc3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c6d9f01-2046-493b-bdf5-ff164b948d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c6d9f01-2046-493b-bdf5-ff164b948d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c12b39d-0178-4b96-9527-ae7a76f97abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c12b39d-0178-4b96-9527-ae7a76f97abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '928f889f-97d4-411a-9562-9c8476b7f17f', 'volume_name': 'volume-928f889f-97d4-411a-9562-9c8476b7f17f', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b690e8a4-dd7b-40ed-911c-7010cc96ff40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b690e8a4-dd7b-40ed-911c-7010cc96ff40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7affffaa-3806-46db-a512-a4781505b8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:16 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] Volume 928f889f-97d4-411a-9562-9c8476b7f17f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-928f889f-97d4-411a-9562-9c8476b7f17f', 'volume_size': 1} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:17 devstack sudo[104792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:17:17 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:17 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f 1073741824" returned: 0 in 0.604s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:17 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f Sep 01 02:17:17 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:17 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.285s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:17 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:17 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager._thread_info {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:17:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread count: 29 {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:17:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread info: [<_MainThread(MainThread, started 128688016527488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:17:17 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f" returned: 0 in 0.269s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.766s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1900585837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a282eb4-b662-4557-90b0-1fe78bf60f94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d57dc4bed339449680c6390c8ae33f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:15Z,use_quota=True,user_id='e5172b41b3074add9a0f35620b8dc3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] Creating volume 8a282eb4-b662-4557-90b0-1fe78bf60f94 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:17 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:17:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a282eb4-b662-4557-90b0-1fe78bf60f94 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff83b82b-14e9-465f-86d5-65a42ee6ef38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:17 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a282eb4-b662-4557-90b0-1fe78bf60f94 1073741824 Sep 01 02:17:17 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc329ba-afad-45d1-8b6a-5d5009ea67b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:17 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Volume volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f (a573ffae-eda5-4b45-852a-e301d4ef2a0f): created successfully Sep 01 02:17:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc329ba-afad-45d1-8b6a-5d5009ea67b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Flow 'volume_create_manager' (df389595-8239-45bf-9fd0-24e0976e2547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:17 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-da0f9cdb-eaac-42c1-bd1a-0f37bf745912 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Created volume successfully. Sep 01 02:17:18 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a282eb4-b662-4557-90b0-1fe78bf60f94 1073741824" returned: 0 in 0.632s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a282eb4-b662-4557-90b0-1fe78bf60f94 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:18 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a282eb4-b662-4557-90b0-1fe78bf60f94 Sep 01 02:17:18 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e3d6d3ae-50f5-4053-a439-ead7aa47e9be tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:18 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a282eb4-b662-4557-90b0-1fe78bf60f94" returned: 0 in 0.375s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.638s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-778016840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=486fa76f-6456-49af-b05e-18cb35771455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d57dc4bed339449680c6390c8ae33f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:16Z,use_quota=True,user_id='e5172b41b3074add9a0f35620b8dc3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] Creating volume 486fa76f-6456-49af-b05e-18cb35771455 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:18 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:18 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:17:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-486fa76f-6456-49af-b05e-18cb35771455 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0712cd18-474f-4513-a65e-da89c4e8c08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a282eb4-b662-4557-90b0-1fe78bf60f94', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:18 devstack sudo[104808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-486fa76f-6456-49af-b05e-18cb35771455 1073741824 Sep 01 02:17:18 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (087416dc-58c7-43e9-9ec2-f7a82b7f4452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:18 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] Volume volume-8a282eb4-b662-4557-90b0-1fe78bf60f94 (8a282eb4-b662-4557-90b0-1fe78bf60f94): created successfully Sep 01 02:17:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (087416dc-58c7-43e9-9ec2-f7a82b7f4452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] Flow 'volume_create_manager' (4ddfd94c-c4af-4cff-891e-789d82d66a6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:18 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-557235c4-dd17-4b66-9966-549f1927f078 tempest-CreateVolumesFromImageTest-2095848695 None] Created volume successfully. Sep 01 02:17:19 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-486fa76f-6456-49af-b05e-18cb35771455 1073741824" returned: 0 in 0.596s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-486fa76f-6456-49af-b05e-18cb35771455 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:19 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-486fa76f-6456-49af-b05e-18cb35771455 Sep 01 02:17:19 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:19 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-486fa76f-6456-49af-b05e-18cb35771455" returned: 0 in 0.274s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:19 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.073s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:19 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-82800461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d509d0a4-737f-46d4-abe1-d56619d16e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d57dc4bed339449680c6390c8ae33f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:16Z,use_quota=True,user_id='e5172b41b3074add9a0f35620b8dc3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:19 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] Creating volume d509d0a4-737f-46d4-abe1-d56619d16e50 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:19 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:19 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:19 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:19 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:17:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d509d0a4-737f-46d4-abe1-d56619d16e50 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:19 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d509d0a4-737f-46d4-abe1-d56619d16e50 1073741824 Sep 01 02:17:19 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ab03885-bbd8-4745-abe9-c0f5c62ddf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-486fa76f-6456-49af-b05e-18cb35771455', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20662274-cd79-443b-987d-7014211d8876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:19 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Flow 'volume_create_manager' (bfb5f719-23b8-4e7c-92eb-cc5fbb634a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909c6ab5-908c-4fa2-8751-4323466d507c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:19 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] Volume volume-486fa76f-6456-49af-b05e-18cb35771455 (486fa76f-6456-49af-b05e-18cb35771455): created successfully Sep 01 02:17:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20662274-cd79-443b-987d-7014211d8876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] Flow 'volume_create_manager' (f07ea7c8-d53a-4aa1-b000-3b6e7285f148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909c6ab5-908c-4fa2-8751-4323466d507c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf3d4b69-57ac-4ebf-9ff1-50586b34bce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7db6c816d1214f46b6838eec5d06f3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:20Z,use_quota=True,user_id='eaca696acd1f4175bf3202da481ff4b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12d59a1d-f952-411e-a912-08c41e645ac7),volume_type_id=12d59a1d-f952-411e-a912-08c41e645ac7)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a6c3fbe-d250-4d3d-ab59-b7be23bfe84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a6c3fbe-d250-4d3d-ab59-b7be23bfe84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3dca4e0-c0a8-4426-b0bb-1d96d06884e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:19 devstack cinder-volume[87128]: DEBUG cinder.image.glance [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Creating Keystone auth plugin from conf {{(pid=87128) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:17:19 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-daacc1e1-93c0-4577-80d1-96d72687f753 tempest-CreateVolumesFromImageTest-2095848695 None] Created volume successfully. Sep 01 02:17:20 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d509d0a4-737f-46d4-abe1-d56619d16e50 1073741824" returned: 0 in 0.598s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d509d0a4-737f-46d4-abe1-d56619d16e50 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:20 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d509d0a4-737f-46d4-abe1-d56619d16e50 Sep 01 02:17:20 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3dca4e0-c0a8-4426-b0bb-1d96d06884e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bf3d4b69-57ac-4ebf-9ff1-50586b34bce8', 'volume_name': 'volume-bf3d4b69-57ac-4ebf-9ff1-50586b34bce8', 'volume_size': 1, 'image_id': 'fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '07579e6c35025baafa3d0b93351cd04f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7db6c816d1214f46b6838eec5d06f3ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b9561c193daa0a8bb7143ea48a22e95de830e0f4891c5cf5aba5e3a9c8ac4a1b4de215466442028903d74802785553e9be308f89f9a14d8907df7e668e2ad90', 'id': 'fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e', 'created_at': datetime.datetime(2026, 9, 1, 0, 17, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 17, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930de2e9-4039-417f-9af1-9c432e6e59c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930de2e9-4039-417f-9af1-9c432e6e59c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423bde16-e18a-4f8b-9d3e-5e59ce333c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:20 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Volume bf3d4b69-57ac-4ebf-9ff1-50586b34bce8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bf3d4b69-57ac-4ebf-9ff1-50586b34bce8', 'volume_size': 1, 'image_id': 'fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '07579e6c35025baafa3d0b93351cd04f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7db6c816d1214f46b6838eec5d06f3ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b9561c193daa0a8bb7143ea48a22e95de830e0f4891c5cf5aba5e3a9c8ac4a1b4de215466442028903d74802785553e9be308f89f9a14d8907df7e668e2ad90', 'id': 'fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e', 'created_at': datetime.datetime(2026, 9, 1, 0, 17, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 17, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 01 02:17:20 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Trying to clone bf3d4b69-57ac-4ebf-9ff1-50586b34bce8 from image fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e at location (None, [{'url': 'file:///opt/stack/data/glance/images/fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e', 'metadata': {}}]). {{(pid=87128) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:17:20 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rm9fqrtzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87128) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:17:20 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Image download 0.00 MB at 0.00 MB/s Sep 01 02:17:20 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d509d0a4-737f-46d4-abe1-d56619d16e50" returned: 0 in 0.286s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:20 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.677s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:20 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1703377648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=928f889f-97d4-411a-9562-9c8476b7f17f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d57dc4bed339449680c6390c8ae33f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:17Z,use_quota=True,user_id='e5172b41b3074add9a0f35620b8dc3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:20 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] Creating volume 928f889f-97d4-411a-9562-9c8476b7f17f {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:20 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:20 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:20 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:20 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:17:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-928f889f-97d4-411a-9562-9c8476b7f17f 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:20 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-928f889f-97d4-411a-9562-9c8476b7f17f 1073741824 Sep 01 02:17:20 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cbaa9ee-f1f1-4576-a740-de9735504ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d509d0a4-737f-46d4-abe1-d56619d16e50', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1564926-720a-4309-8288-be3ba589624e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:20 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6637cf1-209d-401a-89e4-80129c37b2d2]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rm9fqrtzdevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:20 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] Volume volume-d509d0a4-737f-46d4-abe1-d56619d16e50 (d509d0a4-737f-46d4-abe1-d56619d16e50): created successfully Sep 01 02:17:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1564926-720a-4309-8288-be3ba589624e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] Flow 'volume_create_manager' (e0b14ecb-c860-4f0c-9c12-a415bfe73078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:20 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-d1bf36a3-c437-4df1-8ae3-d949dcbd609a tempest-CreateVolumesFromImageTest-2095848695 None] Created volume successfully. Sep 01 02:17:20 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rm9fqrtzdevstack@QuobyteHD Sep 01 02:17:20 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:20 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rm9fqrtzdevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rm9fqrtzdevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:20 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-928f889f-97d4-411a-9562-9c8476b7f17f 1073741824" returned: 0 in 0.490s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-928f889f-97d4-411a-9562-9c8476b7f17f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:21 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rm9fqrtzdevstack@QuobyteHD Sep 01 02:17:21 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:21 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-928f889f-97d4-411a-9562-9c8476b7f17f Sep 01 02:17:21 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:21 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rm9fqrtzdevstack@QuobyteHD" returned: 1 in 0.410s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rm9fqrtzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:17:21 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Temporary image fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e is fetched for user eaca696acd1f4175bf3202da481ff4b5. {{(pid=87128) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:17:21 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-928f889f-97d4-411a-9562-9c8476b7f17f" returned: 0 in 0.297s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e3d6d3ae-50f5-4053-a439-ead7aa47e9be tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.861s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7affffaa-3806-46db-a512-a4781505b8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-928f889f-97d4-411a-9562-9c8476b7f17f', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af825e47-4718-4c0e-8cf1-0a1735bc7ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-e3d6d3ae-50f5-4053-a439-ead7aa47e9be tempest-CreateVolumesFromSnapshotTest-1727005056 None] Creating offline snapshot a16ecdbf-6f49-47ee-9516-4e1287ec5f57 of volume a573ffae-eda5-4b45-852a-e301d4ef2a0f {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:17:21 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] Volume volume-928f889f-97d4-411a-9562-9c8476b7f17f (928f889f-97d4-411a-9562-9c8476b7f17f): created successfully Sep 01 02:17:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af825e47-4718-4c0e-8cf1-0a1735bc7ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] Flow 'volume_create_manager' (71d1f901-3f85-4b87-b7cc-4dd6811aeb4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:21 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee2a8d3-99b5-4e5e-a290-0c8bb6191ba0]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e3d6d3ae-50f5-4053-a439-ead7aa47e9be tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:21 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-3aaaa400-f22b-4480-992e-9648dd81c9e8 tempest-CreateVolumesFromImageTest-2095848695 None] Created volume successfully. Sep 01 02:17:21 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5904a8-4c57-4e13-b8da-3d40639e7993]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rm9fqrtzdevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:21 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f Sep 01 02:17:21 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:21 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rm9fqrtzdevstack@QuobyteHD Sep 01 02:17:21 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:21 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e3d6d3ae-50f5-4053-a439-ead7aa47e9be tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f" returned: 0 in 0.433s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e3d6d3ae-50f5-4053-a439-ead7aa47e9be tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f.a16ecdbf-6f49-47ee-9516-4e1287ec5f57 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:21 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rm9fqrtzdevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rm9fqrtzdevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:21 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f.a16ecdbf-6f49-47ee-9516-4e1287ec5f57 1G Sep 01 02:17:21 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:21 devstack sudo[104856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rm9fqrtzdevstack@QuobyteHD Sep 01 02:17:21 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:22 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rm9fqrtzdevstack@QuobyteHD" returned: 1 in 0.375s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rm9fqrtzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:17:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:22 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e3d6d3ae-50f5-4053-a439-ead7aa47e9be tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f.a16ecdbf-6f49-47ee-9516-4e1287ec5f57 1G" returned: 0 in 0.494s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e3d6d3ae-50f5-4053-a439-ead7aa47e9be tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f.a16ecdbf-6f49-47ee-9516-4e1287ec5f57 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:22 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0167d5e8-82ca-417e-8aee-ba49075ff711 tempest-CreateVolumesFromImageTest-2095848695 None] Acquiring lock "cinder-928f889f-97d4-411a-9562-9c8476b7f17f-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:22 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f.a16ecdbf-6f49-47ee-9516-4e1287ec5f57 Sep 01 02:17:22 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:22 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0167d5e8-82ca-417e-8aee-ba49075ff711 tempest-CreateVolumesFromImageTest-2095848695 None] Lock "cinder-928f889f-97d4-411a-9562-9c8476b7f17f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:22 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0167d5e8-82ca-417e-8aee-ba49075ff711 tempest-CreateVolumesFromImageTest-2095848695 None] Acquiring lock "cinder-quobyte-928f889f-97d4-411a-9562-9c8476b7f17f" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:22 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0167d5e8-82ca-417e-8aee-ba49075ff711 tempest-CreateVolumesFromImageTest-2095848695 None] Lock "cinder-quobyte-928f889f-97d4-411a-9562-9c8476b7f17f" acquired by "delete_volume" :: waited 0.025s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:22 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62364a2-5531-42da-864b-4d0e1cbbf918]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0167d5e8-82ca-417e-8aee-ba49075ff711 tempest-CreateVolumesFromImageTest-2095848695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-928f889f-97d4-411a-9562-9c8476b7f17f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:22 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-928f889f-97d4-411a-9562-9c8476b7f17f Sep 01 02:17:22 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:22 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e3d6d3ae-50f5-4053-a439-ead7aa47e9be tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f.a16ecdbf-6f49-47ee-9516-4e1287ec5f57" returned: 0 in 0.344s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:22 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-e3d6d3ae-50f5-4053-a439-ead7aa47e9be tempest-CreateVolumesFromSnapshotTest-1727005056 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f.a16ecdbf-6f49-47ee-9516-4e1287ec5f57 is being set with open permissions: ugo+rw Sep 01 02:17:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e3d6d3ae-50f5-4053-a439-ead7aa47e9be tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f.a16ecdbf-6f49-47ee-9516-4e1287ec5f57 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:22 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f.a16ecdbf-6f49-47ee-9516-4e1287ec5f57 Sep 01 02:17:22 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:22 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0167d5e8-82ca-417e-8aee-ba49075ff711 tempest-CreateVolumesFromImageTest-2095848695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-928f889f-97d4-411a-9562-9c8476b7f17f" returned: 0 in 0.442s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0167d5e8-82ca-417e-8aee-ba49075ff711 tempest-CreateVolumesFromImageTest-2095848695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-928f889f-97d4-411a-9562-9c8476b7f17f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:22 devstack sudo[104882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-928f889f-97d4-411a-9562-9c8476b7f17f Sep 01 02:17:22 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:22 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e3d6d3ae-50f5-4053-a439-ead7aa47e9be tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f.a16ecdbf-6f49-47ee-9516-4e1287ec5f57" returned: 0 in 0.272s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e3d6d3ae-50f5-4053-a439-ead7aa47e9be tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:23 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f.info Sep 01 02:17:23 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:23 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0167d5e8-82ca-417e-8aee-ba49075ff711 tempest-CreateVolumesFromImageTest-2095848695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-928f889f-97d4-411a-9562-9c8476b7f17f" returned: 0 in 0.282s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0167d5e8-82ca-417e-8aee-ba49075ff711 tempest-CreateVolumesFromImageTest-2095848695 None] Lock "cinder-quobyte-928f889f-97d4-411a-9562-9c8476b7f17f" released by "delete_volume" :: held 0.773s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:23 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e3d6d3ae-50f5-4053-a439-ead7aa47e9be tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f.info" returned: 0 in 0.265s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:23 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-e3d6d3ae-50f5-4053-a439-ead7aa47e9be tempest-CreateVolumesFromSnapshotTest-1727005056 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f.info is being set with open permissions: ugo+rw Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e3d6d3ae-50f5-4053-a439-ead7aa47e9be tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-0167d5e8-82ca-417e-8aee-ba49075ff711 tempest-CreateVolumesFromImageTest-2095848695 None] Created reservations ['d5a387f8-68d5-432e-9c18-b6ec7b308421', '84d17765-95eb-4440-aafe-87dd59611448', 'f2c3284a-4c14-4200-bc89-e62913d2ae42', 'd476749b-96c1-4832-b59a-e6f778116137'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:23 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f.info Sep 01 02:17:23 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0167d5e8-82ca-417e-8aee-ba49075ff711 tempest-CreateVolumesFromImageTest-2095848695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0167d5e8-82ca-417e-8aee-ba49075ff711 tempest-CreateVolumesFromImageTest-2095848695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0167d5e8-82ca-417e-8aee-ba49075ff711 tempest-CreateVolumesFromImageTest-2095848695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0167d5e8-82ca-417e-8aee-ba49075ff711 tempest-CreateVolumesFromImageTest-2095848695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0167d5e8-82ca-417e-8aee-ba49075ff711 tempest-CreateVolumesFromImageTest-2095848695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0167d5e8-82ca-417e-8aee-ba49075ff711 tempest-CreateVolumesFromImageTest-2095848695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:23 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:17:23 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bcf10d85-aeb5-4329-9f6f-327a2ff7a83a tempest-CreateVolumesFromImageTest-2095848695 None] Acquiring lock "cinder-d509d0a4-737f-46d4-abe1-d56619d16e50-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:23 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e3d6d3ae-50f5-4053-a439-ead7aa47e9be tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f.info" returned: 0 in 0.299s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e3d6d3ae-50f5-4053-a439-ead7aa47e9be tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.243s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.359s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf3d4b69-57ac-4ebf-9ff1-50586b34bce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7db6c816d1214f46b6838eec5d06f3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:20Z,use_quota=True,user_id='eaca696acd1f4175bf3202da481ff4b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12d59a1d-f952-411e-a912-08c41e645ac7),volume_type_id=12d59a1d-f952-411e-a912-08c41e645ac7)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Creating volume bf3d4b69-57ac-4ebf-9ff1-50586b34bce8 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:23 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bf3d4b69-57ac-4ebf-9ff1-50586b34bce8 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:23 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bf3d4b69-57ac-4ebf-9ff1-50586b34bce8 1073741824 Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bcf10d85-aeb5-4329-9f6f-327a2ff7a83a tempest-CreateVolumesFromImageTest-2095848695 None] Lock "cinder-d509d0a4-737f-46d4-abe1-d56619d16e50-delete_volume" acquired by "delete_volume" :: waited 0.124s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:23 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:23 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-e3d6d3ae-50f5-4053-a439-ead7aa47e9be tempest-CreateVolumesFromSnapshotTest-1727005056 None] Create snapshot completed successfully Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bcf10d85-aeb5-4329-9f6f-327a2ff7a83a tempest-CreateVolumesFromImageTest-2095848695 None] Acquiring lock "cinder-quobyte-d509d0a4-737f-46d4-abe1-d56619d16e50" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bcf10d85-aeb5-4329-9f6f-327a2ff7a83a tempest-CreateVolumesFromImageTest-2095848695 None] Lock "cinder-quobyte-d509d0a4-737f-46d4-abe1-d56619d16e50" acquired by "delete_volume" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:23 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0167d5e8-82ca-417e-8aee-ba49075ff711 tempest-CreateVolumesFromImageTest-2095848695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.377s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-0167d5e8-82ca-417e-8aee-ba49075ff711 tempest-CreateVolumesFromImageTest-2095848695 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:23 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-0167d5e8-82ca-417e-8aee-ba49075ff711 tempest-CreateVolumesFromImageTest-2095848695 None] Deleted volume successfully. Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c57d00d-0bb8-4fe1-ae61-6a0f02e17849]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bcf10d85-aeb5-4329-9f6f-327a2ff7a83a tempest-CreateVolumesFromImageTest-2095848695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d509d0a4-737f-46d4-abe1-d56619d16e50 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:23 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0167d5e8-82ca-417e-8aee-ba49075ff711 tempest-CreateVolumesFromImageTest-2095848695 None] Lock "cinder-928f889f-97d4-411a-9562-9c8476b7f17f-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:23 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d509d0a4-737f-46d4-abe1-d56619d16e50 Sep 01 02:17:23 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:24 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bcf10d85-aeb5-4329-9f6f-327a2ff7a83a tempest-CreateVolumesFromImageTest-2095848695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d509d0a4-737f-46d4-abe1-d56619d16e50" returned: 0 in 0.400s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bcf10d85-aeb5-4329-9f6f-327a2ff7a83a tempest-CreateVolumesFromImageTest-2095848695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d509d0a4-737f-46d4-abe1-d56619d16e50 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:24 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bf3d4b69-57ac-4ebf-9ff1-50586b34bce8 1073741824" returned: 0 in 0.554s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:24 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d509d0a4-737f-46d4-abe1-d56619d16e50 Sep 01 02:17:24 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bf3d4b69-57ac-4ebf-9ff1-50586b34bce8 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:24 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bf3d4b69-57ac-4ebf-9ff1-50586b34bce8 Sep 01 02:17:24 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:24 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bcf10d85-aeb5-4329-9f6f-327a2ff7a83a tempest-CreateVolumesFromImageTest-2095848695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-d509d0a4-737f-46d4-abe1-d56619d16e50" returned: 0 in 0.283s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bcf10d85-aeb5-4329-9f6f-327a2ff7a83a tempest-CreateVolumesFromImageTest-2095848695 None] Lock "cinder-quobyte-d509d0a4-737f-46d4-abe1-d56619d16e50" released by "delete_volume" :: held 0.740s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:24 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bf3d4b69-57ac-4ebf-9ff1-50586b34bce8" returned: 0 in 0.273s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:24 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:24 devstack cinder-volume[87128]: DEBUG cinder.volume.volume_utils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Attempting download of fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e ((None, [{'url': 'file:///opt/stack/data/glance/images/fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e', 'metadata': {}}])) to volume bf3d4b69-57ac-4ebf-9ff1-50586b34bce8. {{(pid=87128) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:17:24 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-bcf10d85-aeb5-4329-9f6f-327a2ff7a83a tempest-CreateVolumesFromImageTest-2095848695 None] Created reservations ['172a54f2-247a-46aa-acdd-9c8099cddc9e', '403746cb-c89b-441b-9039-57e9fffd1f83', '37a23606-bcd9-4576-8392-d1d6d1444d9a', '0f2fb0a1-6cea-4634-8f3b-7f406e425669'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:24 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f306b2c-6e18-4932-bd3a-e2927bc16b32]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rgjjf1m9 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-bcf10d85-aeb5-4329-9f6f-327a2ff7a83a tempest-CreateVolumesFromImageTest-2095848695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-bcf10d85-aeb5-4329-9f6f-327a2ff7a83a tempest-CreateVolumesFromImageTest-2095848695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:24 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-bcf10d85-aeb5-4329-9f6f-327a2ff7a83a tempest-CreateVolumesFromImageTest-2095848695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:24 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-bcf10d85-aeb5-4329-9f6f-327a2ff7a83a tempest-CreateVolumesFromImageTest-2095848695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-bcf10d85-aeb5-4329-9f6f-327a2ff7a83a tempest-CreateVolumesFromImageTest-2095848695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bcf10d85-aeb5-4329-9f6f-327a2ff7a83a tempest-CreateVolumesFromImageTest-2095848695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:24 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:17:24 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:24 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rgjjf1m9 Sep 01 02:17:24 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-dc73fbd1-b6af-44cb-b2ea-fe4813148eb9 tempest-CreateVolumesFromImageTest-2095848695 None] Acquiring lock "cinder-486fa76f-6456-49af-b05e-18cb35771455-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-dc73fbd1-b6af-44cb-b2ea-fe4813148eb9 tempest-CreateVolumesFromImageTest-2095848695 None] Lock "cinder-486fa76f-6456-49af-b05e-18cb35771455-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-dc73fbd1-b6af-44cb-b2ea-fe4813148eb9 tempest-CreateVolumesFromImageTest-2095848695 None] Acquiring lock "cinder-quobyte-486fa76f-6456-49af-b05e-18cb35771455" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-dc73fbd1-b6af-44cb-b2ea-fe4813148eb9 tempest-CreateVolumesFromImageTest-2095848695 None] Lock "cinder-quobyte-486fa76f-6456-49af-b05e-18cb35771455" acquired by "delete_volume" :: waited 0.033s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:24 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[c250bec1-04b1-41ec-828b-d3e67855765b]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-dc73fbd1-b6af-44cb-b2ea-fe4813148eb9 tempest-CreateVolumesFromImageTest-2095848695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-486fa76f-6456-49af-b05e-18cb35771455 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:24 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bcf10d85-aeb5-4329-9f6f-327a2ff7a83a tempest-CreateVolumesFromImageTest-2095848695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.315s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-bcf10d85-aeb5-4329-9f6f-327a2ff7a83a tempest-CreateVolumesFromImageTest-2095848695 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:25 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-bcf10d85-aeb5-4329-9f6f-327a2ff7a83a tempest-CreateVolumesFromImageTest-2095848695 None] Deleted volume successfully. Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bcf10d85-aeb5-4329-9f6f-327a2ff7a83a tempest-CreateVolumesFromImageTest-2095848695 None] Lock "cinder-d509d0a4-737f-46d4-abe1-d56619d16e50-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:25 devstack sudo[104917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-486fa76f-6456-49af-b05e-18cb35771455 Sep 01 02:17:25 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:25 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rgjjf1m9" returned: 0 in 0.577s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rgjjf1m9 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:25 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rgjjf1m9 Sep 01 02:17:25 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:25 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-dc73fbd1-b6af-44cb-b2ea-fe4813148eb9 tempest-CreateVolumesFromImageTest-2095848695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-486fa76f-6456-49af-b05e-18cb35771455" returned: 0 in 0.504s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-dc73fbd1-b6af-44cb-b2ea-fe4813148eb9 tempest-CreateVolumesFromImageTest-2095848695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-486fa76f-6456-49af-b05e-18cb35771455 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:25 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-486fa76f-6456-49af-b05e-18cb35771455 Sep 01 02:17:25 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Flow 'volume_create_manager' (ac86df78-c3c7-4299-a011-de5f41addc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e1efce2-ece4-4505-a84d-6ff91e189c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e1efce2-ece4-4505-a84d-6ff91e189c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-836038492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5261779-191b-4dc2-a426-a5bd1537333b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5234b938adc54c2ba040025e623336b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:25Z,use_quota=True,user_id='b3890c86807148c591b8d9f07cba620c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf57836-46ed-4abc-9d35-8aad6f7ee42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf57836-46ed-4abc-9d35-8aad6f7ee42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189893d3-710d-44ba-9e57-d41ffa47820e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189893d3-710d-44ba-9e57-d41ffa47820e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5261779-191b-4dc2-a426-a5bd1537333b', 'volume_name': 'volume-f5261779-191b-4dc2-a426-a5bd1537333b', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc350f4e-203b-441f-82be-ba8302741f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc350f4e-203b-441f-82be-ba8302741f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffd2d760-1244-4c10-8b5a-db9a90931366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:25 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Volume f5261779-191b-4dc2-a426-a5bd1537333b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5261779-191b-4dc2-a426-a5bd1537333b', 'volume_size': 1} Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-836038492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5261779-191b-4dc2-a426-a5bd1537333b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5234b938adc54c2ba040025e623336b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:25Z,use_quota=True,user_id='b3890c86807148c591b8d9f07cba620c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Creating volume f5261779-191b-4dc2-a426-a5bd1537333b {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:25 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f5261779-191b-4dc2-a426-a5bd1537333b 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:25 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f5261779-191b-4dc2-a426-a5bd1537333b 1073741824 Sep 01 02:17:25 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:25 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rgjjf1m9" returned: 1 in 0.541s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rgjjf1m9' failed. Not Retrying. {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[d176114e-3b6d-4f2d-80cf-a9ab0f948a5f]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rm9fqrtzdevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:25 devstack sudo[104934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rm9fqrtzdevstack@QuobyteHD Sep 01 02:17:25 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:25 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-dc73fbd1-b6af-44cb-b2ea-fe4813148eb9 tempest-CreateVolumesFromImageTest-2095848695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-486fa76f-6456-49af-b05e-18cb35771455" returned: 0 in 0.513s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-dc73fbd1-b6af-44cb-b2ea-fe4813148eb9 tempest-CreateVolumesFromImageTest-2095848695 None] Lock "cinder-quobyte-486fa76f-6456-49af-b05e-18cb35771455" released by "delete_volume" :: held 1.098s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] Flow 'volume_create_manager' (1cd27009-63f7-4f96-850a-b0d08bffd58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ddef1c-9547-404f-8de0-704c572c4650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ddef1c-9547-404f-8de0-704c572c4650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1756300660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9a5827-8ed1-433c-a07c-4fa88ce75d57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5234b938adc54c2ba040025e623336b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:26Z,use_quota=True,user_id='b3890c86807148c591b8d9f07cba620c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0813280-2a61-4efe-9eca-ee972967ea37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0813280-2a61-4efe-9eca-ee972967ea37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dbdc72c-394b-403f-ae5f-0b632c81a300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dbdc72c-394b-403f-ae5f-0b632c81a300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd9a5827-8ed1-433c-a07c-4fa88ce75d57', 'volume_name': 'volume-cd9a5827-8ed1-433c-a07c-4fa88ce75d57', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7039e318-fbbe-40c9-8357-1c59a851764a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7039e318-fbbe-40c9-8357-1c59a851764a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c96796a2-0d48-4f4b-877d-43960e84b5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:26 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] Volume cd9a5827-8ed1-433c-a07c-4fa88ce75d57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd9a5827-8ed1-433c-a07c-4fa88ce75d57', 'volume_size': 1} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-dc73fbd1-b6af-44cb-b2ea-fe4813148eb9 tempest-CreateVolumesFromImageTest-2095848695 None] Created reservations ['5dc216ca-a5f6-45f3-919a-250dd86d8d8b', '1a110fd4-2ef9-4af1-b5e6-b6d4ebada7b8', 'b2c9ee5d-a61a-46b8-9708-6d4a6c4674eb', 'b4f33e39-a322-49bb-a8ea-813ad37e3d06'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:26 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rm9fqrtzdevstack@QuobyteHD" returned: 0 in 0.558s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rm9fqrtzdevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:26 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f5261779-191b-4dc2-a426-a5bd1537333b 1073741824" returned: 0 in 0.691s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-dc73fbd1-b6af-44cb-b2ea-fe4813148eb9 tempest-CreateVolumesFromImageTest-2095848695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-dc73fbd1-b6af-44cb-b2ea-fe4813148eb9 tempest-CreateVolumesFromImageTest-2095848695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-dc73fbd1-b6af-44cb-b2ea-fe4813148eb9 tempest-CreateVolumesFromImageTest-2095848695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-dc73fbd1-b6af-44cb-b2ea-fe4813148eb9 tempest-CreateVolumesFromImageTest-2095848695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-dc73fbd1-b6af-44cb-b2ea-fe4813148eb9 tempest-CreateVolumesFromImageTest-2095848695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-dc73fbd1-b6af-44cb-b2ea-fe4813148eb9 tempest-CreateVolumesFromImageTest-2095848695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f5261779-191b-4dc2-a426-a5bd1537333b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:26 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:17:26 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:26 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f5261779-191b-4dc2-a426-a5bd1537333b Sep 01 02:17:26 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:26 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rm9fqrtzdevstack@QuobyteHD Sep 01 02:17:26 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Flow 'volume_create_manager' (05c9528e-609a-4728-b31b-6f67e247c0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd5d26c-6912-4158-8d14-82d910c6fcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd5d26c-6912-4158-8d14-82d910c6fcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-793655000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e037f2a0-2dd5-4cb2-bdc3-58359fa27f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5234b938adc54c2ba040025e623336b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:27Z,use_quota=True,user_id='b3890c86807148c591b8d9f07cba620c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4d00d4-e0b0-47a2-84ee-afeb5988746c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:26 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4d00d4-e0b0-47a2-84ee-afeb5988746c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a1e4f3-37c1-4b71-b5e4-398b0a45494a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:26 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a1e4f3-37c1-4b71-b5e4-398b0a45494a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e037f2a0-2dd5-4cb2-bdc3-58359fa27f07', 'volume_name': 'volume-e037f2a0-2dd5-4cb2-bdc3-58359fa27f07', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6cdb8ba-ef55-4d7c-8a6d-984349f4cfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6cdb8ba-ef55-4d7c-8a6d-984349f4cfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b6fe670-3ee7-4cf9-8618-24aa641d9146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:26 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Volume e037f2a0-2dd5-4cb2-bdc3-58359fa27f07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e037f2a0-2dd5-4cb2-bdc3-58359fa27f07', 'volume_size': 1} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-dc73fbd1-b6af-44cb-b2ea-fe4813148eb9 tempest-CreateVolumesFromImageTest-2095848695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.476s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f5261779-191b-4dc2-a426-a5bd1537333b" returned: 0 in 0.461s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-dc73fbd1-b6af-44cb-b2ea-fe4813148eb9 tempest-CreateVolumesFromImageTest-2095848695 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.643s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1756300660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9a5827-8ed1-433c-a07c-4fa88ce75d57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5234b938adc54c2ba040025e623336b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:26Z,use_quota=True,user_id='b3890c86807148c591b8d9f07cba620c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] Creating volume cd9a5827-8ed1-433c-a07c-4fa88ce75d57 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:26 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd9a5827-8ed1-433c-a07c-4fa88ce75d57 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:26 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-dc73fbd1-b6af-44cb-b2ea-fe4813148eb9 tempest-CreateVolumesFromImageTest-2095848695 None] Deleted volume successfully. Sep 01 02:17:26 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd9a5827-8ed1-433c-a07c-4fa88ce75d57 1073741824 Sep 01 02:17:26 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffd2d760-1244-4c10-8b5a-db9a90931366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5261779-191b-4dc2-a426-a5bd1537333b', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e43b043-228e-466c-97e6-973e9c86243f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:26 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Volume volume-f5261779-191b-4dc2-a426-a5bd1537333b (f5261779-191b-4dc2-a426-a5bd1537333b): created successfully Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e43b043-228e-466c-97e6-973e9c86243f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Flow 'volume_create_manager' (ac86df78-c3c7-4299-a011-de5f41addc88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-dc73fbd1-b6af-44cb-b2ea-fe4813148eb9 tempest-CreateVolumesFromImageTest-2095848695 None] Lock "cinder-486fa76f-6456-49af-b05e-18cb35771455-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:26 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rm9fqrtzdevstack@QuobyteHD" returned: 1 in 0.718s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rm9fqrtzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:17:26 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e was raw, converting to qcow2 {{(pid=87128) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:17:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rm9fqrtzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bf3d4b69-57ac-4ebf-9ff1-50586b34bce8 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:27 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-901392ad-6b07-490e-b54f-c02666b20b20 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Created volume successfully. Sep 01 02:17:27 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rm9fqrtzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bf3d4b69-57ac-4ebf-9ff1-50586b34bce8 Sep 01 02:17:27 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:27 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8a95b800-ba16-48c5-98a6-a53ea593a5dc tempest-CreateVolumesFromImageTest-2095848695 None] Acquiring lock "cinder-8a282eb4-b662-4557-90b0-1fe78bf60f94-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:27 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8a95b800-ba16-48c5-98a6-a53ea593a5dc tempest-CreateVolumesFromImageTest-2095848695 None] Lock "cinder-8a282eb4-b662-4557-90b0-1fe78bf60f94-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:27 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Flow 'volume_create_manager' (d145c979-46e7-4432-b396-915e1dfe1168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa100250-cf76-4e43-9bc6-3869713d2b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa100250-cf76-4e43-9bc6-3869713d2b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-678596776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b1766b6-9ef7-43f1-9207-00d8bcff760b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5234b938adc54c2ba040025e623336b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:27Z,use_quota=True,user_id='b3890c86807148c591b8d9f07cba620c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d04d6c5-fdbe-41c8-baeb-36e1a257f546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d04d6c5-fdbe-41c8-baeb-36e1a257f546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0703c3-c928-4eeb-8568-100a103c2775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0703c3-c928-4eeb-8568-100a103c2775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b1766b6-9ef7-43f1-9207-00d8bcff760b', 'volume_name': 'volume-7b1766b6-9ef7-43f1-9207-00d8bcff760b', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3194b607-cf40-4c3e-8e55-f900f50a77c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3194b607-cf40-4c3e-8e55-f900f50a77c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:27 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aedf8389-aba4-413d-9b6c-7ad66a777c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:27 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Volume 7b1766b6-9ef7-43f1-9207-00d8bcff760b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b1766b6-9ef7-43f1-9207-00d8bcff760b', 'volume_size': 1} Sep 01 02:17:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd9a5827-8ed1-433c-a07c-4fa88ce75d57 1073741824" returned: 0 in 0.726s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:27 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8a95b800-ba16-48c5-98a6-a53ea593a5dc tempest-CreateVolumesFromImageTest-2095848695 None] Acquiring lock "cinder-quobyte-8a282eb4-b662-4557-90b0-1fe78bf60f94" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:27 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8a95b800-ba16-48c5-98a6-a53ea593a5dc tempest-CreateVolumesFromImageTest-2095848695 None] Lock "cinder-quobyte-8a282eb4-b662-4557-90b0-1fe78bf60f94" acquired by "delete_volume" :: waited 0.025s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd9a5827-8ed1-433c-a07c-4fa88ce75d57 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:27 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a574b7d-81c6-4016-8a9e-59b1f0bbdf2a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8a95b800-ba16-48c5-98a6-a53ea593a5dc tempest-CreateVolumesFromImageTest-2095848695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a282eb4-b662-4557-90b0-1fe78bf60f94 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:27 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd9a5827-8ed1-433c-a07c-4fa88ce75d57 Sep 01 02:17:27 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:27 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rm9fqrtzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bf3d4b69-57ac-4ebf-9ff1-50586b34bce8" returned: 0 in 0.862s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:27 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e_rm9fqrtzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bf3d4b69-57ac-4ebf-9ff1-50586b34bce8 {{(pid=87128) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:17:27 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 02:17:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bf3d4b69-57ac-4ebf-9ff1-50586b34bce8 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:27 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a282eb4-b662-4557-90b0-1fe78bf60f94 Sep 01 02:17:27 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:27 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bf3d4b69-57ac-4ebf-9ff1-50586b34bce8 1G Sep 01 02:17:27 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:28 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd9a5827-8ed1-433c-a07c-4fa88ce75d57" returned: 0 in 0.376s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.230s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-793655000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e037f2a0-2dd5-4cb2-bdc3-58359fa27f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5234b938adc54c2ba040025e623336b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:27Z,use_quota=True,user_id='b3890c86807148c591b8d9f07cba620c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Creating volume e037f2a0-2dd5-4cb2-bdc3-58359fa27f07 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:28 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e037f2a0-2dd5-4cb2-bdc3-58359fa27f07 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c96796a2-0d48-4f4b-877d-43960e84b5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd9a5827-8ed1-433c-a07c-4fa88ce75d57', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41578b38-0ed7-42b7-83a3-36cb27d5d00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:28 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e037f2a0-2dd5-4cb2-bdc3-58359fa27f07 1073741824 Sep 01 02:17:28 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:28 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] Volume volume-cd9a5827-8ed1-433c-a07c-4fa88ce75d57 (cd9a5827-8ed1-433c-a07c-4fa88ce75d57): created successfully Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41578b38-0ed7-42b7-83a3-36cb27d5d00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] Flow 'volume_create_manager' (1cd27009-63f7-4f96-850a-b0d08bffd58a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:28 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-be35a3ae-7d9d-4166-b921-0a91ef9cc40f tempest-CreateVolumesFromSnapshotTest-1727005056 None] Created volume successfully. Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Flow 'volume_create_manager' (fb5a217e-e6e7-4892-a567-61de0d3c17e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b3e2ca-e273-4a41-adae-99f22323691c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b3e2ca-e273-4a41-adae-99f22323691c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-278365577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a4209c0-815e-4f37-b1d1-8251088227f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5234b938adc54c2ba040025e623336b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:28Z,use_quota=True,user_id='b3890c86807148c591b8d9f07cba620c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ee211e-5106-494c-ab42-8820ff30666e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ee211e-5106-494c-ab42-8820ff30666e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16822cd5-e973-4566-a09a-3ce0c91459a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16822cd5-e973-4566-a09a-3ce0c91459a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a4209c0-815e-4f37-b1d1-8251088227f3', 'volume_name': 'volume-9a4209c0-815e-4f37-b1d1-8251088227f3', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff78d0c-9e50-473f-acaf-1c502102eef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff78d0c-9e50-473f-acaf-1c502102eef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b38493a9-9a0a-4dee-8514-cd438dec7d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:28 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Volume 9a4209c0-815e-4f37-b1d1-8251088227f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a4209c0-815e-4f37-b1d1-8251088227f3', 'volume_size': 1} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:28 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8a95b800-ba16-48c5-98a6-a53ea593a5dc tempest-CreateVolumesFromImageTest-2095848695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a282eb4-b662-4557-90b0-1fe78bf60f94" returned: 0 in 0.765s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8a95b800-ba16-48c5-98a6-a53ea593a5dc tempest-CreateVolumesFromImageTest-2095848695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a282eb4-b662-4557-90b0-1fe78bf60f94 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:28 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a282eb4-b662-4557-90b0-1fe78bf60f94 Sep 01 02:17:28 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:28 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bf3d4b69-57ac-4ebf-9ff1-50586b34bce8 1G" returned: 0 in 0.686s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.volume_utils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Downloaded image fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e ((None, [{'url': 'file:///opt/stack/data/glance/images/fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e', 'metadata': {}}])) to volume bf3d4b69-57ac-4ebf-9ff1-50586b34bce8 successfully. {{(pid=87128) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Temporary image fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e for user eaca696acd1f4175bf3202da481ff4b5 is deleted. {{(pid=87128) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.volume_utils [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Marking volume bf3d4b69-57ac-4ebf-9ff1-50586b34bce8 as bootable. {{(pid=87128) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Copying metadata from image fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e to bf3d4b69-57ac-4ebf-9ff1-50586b34bce8. {{(pid=87128) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Creating volume glance metadata for volume bf3d4b69-57ac-4ebf-9ff1-50586b34bce8 backed by image fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '07579e6c35025baafa3d0b93351cd04f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87128) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423bde16-e18a-4f8b-9d3e-5e59ce333c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf3d4b69-57ac-4ebf-9ff1-50586b34bce8', 'volume_size': 1, 'image_id': 'fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '07579e6c35025baafa3d0b93351cd04f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7db6c816d1214f46b6838eec5d06f3ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b9561c193daa0a8bb7143ea48a22e95de830e0f4891c5cf5aba5e3a9c8ac4a1b4de215466442028903d74802785553e9be308f89f9a14d8907df7e668e2ad90', 'id': 'fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e', 'created_at': datetime.datetime(2026, 9, 1, 0, 17, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 17, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fd5dfdb2-ea2e-46c1-af40-4f9fefbee26e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893ef91f-cb9c-4799-a889-6dd7a59451c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:28 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Volume volume-bf3d4b69-57ac-4ebf-9ff1-50586b34bce8 (bf3d4b69-57ac-4ebf-9ff1-50586b34bce8): created successfully Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893ef91f-cb9c-4799-a889-6dd7a59451c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Flow 'volume_create_manager' (bfb5f719-23b8-4e7c-92eb-cc5fbb634a42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:28 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-4a3c26dd-a6ef-45b2-a127-4b3080ced604 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Created volume successfully. Sep 01 02:17:28 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8a95b800-ba16-48c5-98a6-a53ea593a5dc tempest-CreateVolumesFromImageTest-2095848695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-8a282eb4-b662-4557-90b0-1fe78bf60f94" returned: 0 in 0.331s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8a95b800-ba16-48c5-98a6-a53ea593a5dc tempest-CreateVolumesFromImageTest-2095848695 None] Lock "cinder-quobyte-8a282eb4-b662-4557-90b0-1fe78bf60f94" released by "delete_volume" :: held 1.175s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:28 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e037f2a0-2dd5-4cb2-bdc3-58359fa27f07 1073741824" returned: 0 in 0.740s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e037f2a0-2dd5-4cb2-bdc3-58359fa27f07 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-8a95b800-ba16-48c5-98a6-a53ea593a5dc tempest-CreateVolumesFromImageTest-2095848695 None] Created reservations ['a88b8243-d89c-496f-a9bb-9a6f302774b8', '3c2886ff-8f99-48a1-a19b-4cc6b672f412', '8a28851a-770c-4b95-b0fb-87e083bb586b', 'b2ed5dac-964f-44b4-baef-7f3c0d080155'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:28 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e037f2a0-2dd5-4cb2-bdc3-58359fa27f07 Sep 01 02:17:28 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8a95b800-ba16-48c5-98a6-a53ea593a5dc tempest-CreateVolumesFromImageTest-2095848695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8a95b800-ba16-48c5-98a6-a53ea593a5dc tempest-CreateVolumesFromImageTest-2095848695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8a95b800-ba16-48c5-98a6-a53ea593a5dc tempest-CreateVolumesFromImageTest-2095848695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8a95b800-ba16-48c5-98a6-a53ea593a5dc tempest-CreateVolumesFromImageTest-2095848695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8a95b800-ba16-48c5-98a6-a53ea593a5dc tempest-CreateVolumesFromImageTest-2095848695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8a95b800-ba16-48c5-98a6-a53ea593a5dc tempest-CreateVolumesFromImageTest-2095848695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:28 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:17:28 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:29 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e037f2a0-2dd5-4cb2-bdc3-58359fa27f07" returned: 0 in 0.262s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.551s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-678596776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b1766b6-9ef7-43f1-9207-00d8bcff760b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5234b938adc54c2ba040025e623336b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:27Z,use_quota=True,user_id='b3890c86807148c591b8d9f07cba620c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Creating volume 7b1766b6-9ef7-43f1-9207-00d8bcff760b {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:29 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7b1766b6-9ef7-43f1-9207-00d8bcff760b 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b6fe670-3ee7-4cf9-8618-24aa641d9146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e037f2a0-2dd5-4cb2-bdc3-58359fa27f07', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:29 devstack sudo[105035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7b1766b6-9ef7-43f1-9207-00d8bcff760b 1073741824 Sep 01 02:17:29 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44f753ef-421b-4148-8588-501fb15a3b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:29 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Volume volume-e037f2a0-2dd5-4cb2-bdc3-58359fa27f07 (e037f2a0-2dd5-4cb2-bdc3-58359fa27f07): created successfully Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44f753ef-421b-4148-8588-501fb15a3b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Flow 'volume_create_manager' (05c9528e-609a-4728-b31b-6f67e247c0d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:29 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-1cd8c543-03fa-43e2-8396-b1afeddc6701 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Created volume successfully. Sep 01 02:17:29 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8a95b800-ba16-48c5-98a6-a53ea593a5dc tempest-CreateVolumesFromImageTest-2095848695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.314s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-8a95b800-ba16-48c5-98a6-a53ea593a5dc tempest-CreateVolumesFromImageTest-2095848695 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:29 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-8a95b800-ba16-48c5-98a6-a53ea593a5dc tempest-CreateVolumesFromImageTest-2095848695 None] Deleted volume successfully. Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-8a95b800-ba16-48c5-98a6-a53ea593a5dc tempest-CreateVolumesFromImageTest-2095848695 None] Lock "cinder-8a282eb4-b662-4557-90b0-1fe78bf60f94-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0875bdea-ed2b-418e-9a7b-36f5aaa61fe0 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Acquiring lock "cinder-bf3d4b69-57ac-4ebf-9ff1-50586b34bce8-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0875bdea-ed2b-418e-9a7b-36f5aaa61fe0 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Lock "cinder-bf3d4b69-57ac-4ebf-9ff1-50586b34bce8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0875bdea-ed2b-418e-9a7b-36f5aaa61fe0 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Acquiring lock "cinder-quobyte-bf3d4b69-57ac-4ebf-9ff1-50586b34bce8" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0875bdea-ed2b-418e-9a7b-36f5aaa61fe0 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Lock "cinder-quobyte-bf3d4b69-57ac-4ebf-9ff1-50586b34bce8" acquired by "delete_volume" :: waited 0.023s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[377e2c70-1da9-4408-afdd-40b61ab7ee9b]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0875bdea-ed2b-418e-9a7b-36f5aaa61fe0 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bf3d4b69-57ac-4ebf-9ff1-50586b34bce8 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:29 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b395a699-9a57-4b6c-b7aa-702c9146572e tempest-CreateVolumesFromImageTest-2095848695 None] Acquiring lock "cinder-dacefde0-41a3-4045-9ebf-9375942dd797-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:29 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bf3d4b69-57ac-4ebf-9ff1-50586b34bce8 Sep 01 02:17:29 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7b1766b6-9ef7-43f1-9207-00d8bcff760b 1073741824" returned: 0 in 0.614s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b395a699-9a57-4b6c-b7aa-702c9146572e tempest-CreateVolumesFromImageTest-2095848695 None] Lock "cinder-dacefde0-41a3-4045-9ebf-9375942dd797-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7b1766b6-9ef7-43f1-9207-00d8bcff760b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b395a699-9a57-4b6c-b7aa-702c9146572e tempest-CreateVolumesFromImageTest-2095848695 None] Acquiring lock "cinder-quobyte-dacefde0-41a3-4045-9ebf-9375942dd797" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:29 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7b1766b6-9ef7-43f1-9207-00d8bcff760b Sep 01 02:17:29 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b395a699-9a57-4b6c-b7aa-702c9146572e tempest-CreateVolumesFromImageTest-2095848695 None] Lock "cinder-quobyte-dacefde0-41a3-4045-9ebf-9375942dd797" acquired by "delete_volume" :: waited 0.029s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e453678-659a-4f4f-bbc0-c8b15657ef9e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b395a699-9a57-4b6c-b7aa-702c9146572e tempest-CreateVolumesFromImageTest-2095848695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dacefde0-41a3-4045-9ebf-9375942dd797 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:30 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dacefde0-41a3-4045-9ebf-9375942dd797 Sep 01 02:17:30 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:30 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0875bdea-ed2b-418e-9a7b-36f5aaa61fe0 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bf3d4b69-57ac-4ebf-9ff1-50586b34bce8" returned: 0 in 0.506s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0875bdea-ed2b-418e-9a7b-36f5aaa61fe0 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bf3d4b69-57ac-4ebf-9ff1-50586b34bce8 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:30 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bf3d4b69-57ac-4ebf-9ff1-50586b34bce8 Sep 01 02:17:30 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:30 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7b1766b6-9ef7-43f1-9207-00d8bcff760b" returned: 0 in 0.344s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.751s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-278365577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a4209c0-815e-4f37-b1d1-8251088227f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5234b938adc54c2ba040025e623336b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:28Z,use_quota=True,user_id='b3890c86807148c591b8d9f07cba620c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Creating volume 9a4209c0-815e-4f37-b1d1-8251088227f3 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:30 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9a4209c0-815e-4f37-b1d1-8251088227f3 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aedf8389-aba4-413d-9b6c-7ad66a777c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b1766b6-9ef7-43f1-9207-00d8bcff760b', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e9e3438-44e5-4da5-81d3-dd983eed9e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:30 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9a4209c0-815e-4f37-b1d1-8251088227f3 1073741824 Sep 01 02:17:30 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:30 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Volume volume-7b1766b6-9ef7-43f1-9207-00d8bcff760b (7b1766b6-9ef7-43f1-9207-00d8bcff760b): created successfully Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e9e3438-44e5-4da5-81d3-dd983eed9e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Flow 'volume_create_manager' (d145c979-46e7-4432-b396-915e1dfe1168) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:30 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-0d71a765-6af5-45d6-a85f-4cdaa3141687 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Created volume successfully. Sep 01 02:17:30 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b395a699-9a57-4b6c-b7aa-702c9146572e tempest-CreateVolumesFromImageTest-2095848695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dacefde0-41a3-4045-9ebf-9375942dd797" returned: 0 in 0.411s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b395a699-9a57-4b6c-b7aa-702c9146572e tempest-CreateVolumesFromImageTest-2095848695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dacefde0-41a3-4045-9ebf-9375942dd797 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:30 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dacefde0-41a3-4045-9ebf-9375942dd797 Sep 01 02:17:30 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:30 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0875bdea-ed2b-418e-9a7b-36f5aaa61fe0 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-bf3d4b69-57ac-4ebf-9ff1-50586b34bce8" returned: 0 in 0.322s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0875bdea-ed2b-418e-9a7b-36f5aaa61fe0 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Lock "cinder-quobyte-bf3d4b69-57ac-4ebf-9ff1-50586b34bce8" released by "delete_volume" :: held 0.882s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-0875bdea-ed2b-418e-9a7b-36f5aaa61fe0 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Created reservations ['b31c6efd-06cd-4294-8a1c-029a3801b977', 'e549f3c0-9697-43ed-a9f3-ee84d73b0ac0', 'b7a394f4-5773-4a66-936e-12ed6c5511f9', 'deaa0c2c-844f-4c39-83c5-6f44daeff6a5'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0875bdea-ed2b-418e-9a7b-36f5aaa61fe0 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0875bdea-ed2b-418e-9a7b-36f5aaa61fe0 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0875bdea-ed2b-418e-9a7b-36f5aaa61fe0 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0875bdea-ed2b-418e-9a7b-36f5aaa61fe0 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0875bdea-ed2b-418e-9a7b-36f5aaa61fe0 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0875bdea-ed2b-418e-9a7b-36f5aaa61fe0 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:30 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:30 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:17:30 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b395a699-9a57-4b6c-b7aa-702c9146572e tempest-CreateVolumesFromImageTest-2095848695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-dacefde0-41a3-4045-9ebf-9375942dd797" returned: 0 in 0.359s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b395a699-9a57-4b6c-b7aa-702c9146572e tempest-CreateVolumesFromImageTest-2095848695 None] Lock "cinder-quobyte-dacefde0-41a3-4045-9ebf-9375942dd797" released by "delete_volume" :: held 0.814s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-b395a699-9a57-4b6c-b7aa-702c9146572e tempest-CreateVolumesFromImageTest-2095848695 None] Created reservations ['d02a04ff-83d7-4877-9f7b-8f6f5d481c54', '520ee546-e7c7-42cf-9065-8efd6c28c9a7', '292f5c70-5d3e-41f3-83aa-ae3871586891', '76930352-cdb4-4d24-a6c7-b4e12c38ff09'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:30 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9a4209c0-815e-4f37-b1d1-8251088227f3 1073741824" returned: 0 in 0.606s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b395a699-9a57-4b6c-b7aa-702c9146572e tempest-CreateVolumesFromImageTest-2095848695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b395a699-9a57-4b6c-b7aa-702c9146572e tempest-CreateVolumesFromImageTest-2095848695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b395a699-9a57-4b6c-b7aa-702c9146572e tempest-CreateVolumesFromImageTest-2095848695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b395a699-9a57-4b6c-b7aa-702c9146572e tempest-CreateVolumesFromImageTest-2095848695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b395a699-9a57-4b6c-b7aa-702c9146572e tempest-CreateVolumesFromImageTest-2095848695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b395a699-9a57-4b6c-b7aa-702c9146572e tempest-CreateVolumesFromImageTest-2095848695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9a4209c0-815e-4f37-b1d1-8251088227f3 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:30 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:17:30 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:30 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9a4209c0-815e-4f37-b1d1-8251088227f3 Sep 01 02:17:30 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:30 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0875bdea-ed2b-418e-9a7b-36f5aaa61fe0 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.314s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:30 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-0875bdea-ed2b-418e-9a7b-36f5aaa61fe0 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:30 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-0875bdea-ed2b-418e-9a7b-36f5aaa61fe0 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Deleted volume successfully. Sep 01 02:17:31 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0875bdea-ed2b-418e-9a7b-36f5aaa61fe0 tempest-VolumeAndVolumeTypeFromImageTest-2085834385 None] Lock "cinder-bf3d4b69-57ac-4ebf-9ff1-50586b34bce8-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:31 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9a4209c0-815e-4f37-b1d1-8251088227f3" returned: 0 in 0.295s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:31 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:31 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b38493a9-9a0a-4dee-8514-cd438dec7d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a4209c0-815e-4f37-b1d1-8251088227f3', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b1f4d61-870f-4de4-b85a-b624636dc595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b395a699-9a57-4b6c-b7aa-702c9146572e tempest-CreateVolumesFromImageTest-2095848695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.352s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:31 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-b395a699-9a57-4b6c-b7aa-702c9146572e tempest-CreateVolumesFromImageTest-2095848695 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:31 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-b395a699-9a57-4b6c-b7aa-702c9146572e tempest-CreateVolumesFromImageTest-2095848695 None] Deleted volume successfully. Sep 01 02:17:31 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Volume volume-9a4209c0-815e-4f37-b1d1-8251088227f3 (9a4209c0-815e-4f37-b1d1-8251088227f3): created successfully Sep 01 02:17:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b1f4d61-870f-4de4-b85a-b624636dc595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Flow 'volume_create_manager' (fb5a217e-e6e7-4892-a567-61de0d3c17e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:31 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-f015391d-a7d3-4f42-8bca-23c4883b7cc8 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Created volume successfully. Sep 01 02:17:31 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b395a699-9a57-4b6c-b7aa-702c9146572e tempest-CreateVolumesFromImageTest-2095848695 None] Lock "cinder-dacefde0-41a3-4045-9ebf-9375942dd797-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:31 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5dd30796-c965-4602-8c4d-bbabab2ddc83 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "cinder-9a4209c0-815e-4f37-b1d1-8251088227f3-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:31 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5dd30796-c965-4602-8c4d-bbabab2ddc83 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "cinder-9a4209c0-815e-4f37-b1d1-8251088227f3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:31 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5dd30796-c965-4602-8c4d-bbabab2ddc83 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "cinder-quobyte-9a4209c0-815e-4f37-b1d1-8251088227f3" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:31 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5dd30796-c965-4602-8c4d-bbabab2ddc83 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "cinder-quobyte-9a4209c0-815e-4f37-b1d1-8251088227f3" acquired by "delete_volume" :: waited 0.030s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:31 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12ee3e1-921f-44ac-95a2-014c08731a95]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5dd30796-c965-4602-8c4d-bbabab2ddc83 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9a4209c0-815e-4f37-b1d1-8251088227f3 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:32 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9a4209c0-815e-4f37-b1d1-8251088227f3 Sep 01 02:17:32 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:32 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5dd30796-c965-4602-8c4d-bbabab2ddc83 tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9a4209c0-815e-4f37-b1d1-8251088227f3" returned: 0 in 0.492s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5dd30796-c965-4602-8c4d-bbabab2ddc83 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9a4209c0-815e-4f37-b1d1-8251088227f3 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:32 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9a4209c0-815e-4f37-b1d1-8251088227f3 Sep 01 02:17:32 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:32 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5dd30796-c965-4602-8c4d-bbabab2ddc83 tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-9a4209c0-815e-4f37-b1d1-8251088227f3" returned: 0 in 0.454s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:32 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5dd30796-c965-4602-8c4d-bbabab2ddc83 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "cinder-quobyte-9a4209c0-815e-4f37-b1d1-8251088227f3" released by "delete_volume" :: held 1.025s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:32 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-5dd30796-c965-4602-8c4d-bbabab2ddc83 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Created reservations ['6ff03555-5b39-4bd8-bd2a-5d476679990d', 'a3f4375d-578f-48b0-8d64-2e0a3580cddf', '59c05835-f4cd-42eb-9669-51ce26f6fd81', '773b554c-deca-481d-a55b-a7efa1a27c61'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5dd30796-c965-4602-8c4d-bbabab2ddc83 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5dd30796-c965-4602-8c4d-bbabab2ddc83 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5dd30796-c965-4602-8c4d-bbabab2ddc83 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5dd30796-c965-4602-8c4d-bbabab2ddc83 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5dd30796-c965-4602-8c4d-bbabab2ddc83 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5dd30796-c965-4602-8c4d-bbabab2ddc83 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:33 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:17:33 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:33 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5dd30796-c965-4602-8c4d-bbabab2ddc83 tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.299s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:33 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-5dd30796-c965-4602-8c4d-bbabab2ddc83 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:33 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-5dd30796-c965-4602-8c4d-bbabab2ddc83 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Deleted volume successfully. Sep 01 02:17:33 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5dd30796-c965-4602-8c4d-bbabab2ddc83 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "cinder-9a4209c0-815e-4f37-b1d1-8251088227f3-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6a85ee37-e924-4151-85aa-fc53b4a231d0 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "cinder-7b1766b6-9ef7-43f1-9207-00d8bcff760b-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6a85ee37-e924-4151-85aa-fc53b4a231d0 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "cinder-7b1766b6-9ef7-43f1-9207-00d8bcff760b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6a85ee37-e924-4151-85aa-fc53b4a231d0 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "cinder-quobyte-7b1766b6-9ef7-43f1-9207-00d8bcff760b" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6a85ee37-e924-4151-85aa-fc53b4a231d0 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "cinder-quobyte-7b1766b6-9ef7-43f1-9207-00d8bcff760b" acquired by "delete_volume" :: waited 0.021s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:34 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[194a9474-b9bd-497e-8116-c70f8dd12166]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6a85ee37-e924-4151-85aa-fc53b4a231d0 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7b1766b6-9ef7-43f1-9207-00d8bcff760b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:34 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7b1766b6-9ef7-43f1-9207-00d8bcff760b Sep 01 02:17:34 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:34 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6a85ee37-e924-4151-85aa-fc53b4a231d0 tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7b1766b6-9ef7-43f1-9207-00d8bcff760b" returned: 0 in 0.491s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6a85ee37-e924-4151-85aa-fc53b4a231d0 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7b1766b6-9ef7-43f1-9207-00d8bcff760b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:34 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7b1766b6-9ef7-43f1-9207-00d8bcff760b Sep 01 02:17:34 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:35 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6a85ee37-e924-4151-85aa-fc53b4a231d0 tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-7b1766b6-9ef7-43f1-9207-00d8bcff760b" returned: 0 in 0.380s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6a85ee37-e924-4151-85aa-fc53b4a231d0 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "cinder-quobyte-7b1766b6-9ef7-43f1-9207-00d8bcff760b" released by "delete_volume" :: held 0.944s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] Flow 'volume_create_manager' (0dfa7f6b-55e0-4c45-a409-c898ac7e9f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc1b7aa-84b0-4158-bbdf-008bef594aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc1b7aa-84b0-4158-bbdf-008bef594aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-72498673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59dd4917-3487-4933-8e59-9adce1652737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f580950931479a97ae84b6a964fd69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:35Z,use_quota=True,user_id='2f23b34ca87d4f76ad78b093a58bc892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fcd6e9d-5c4d-49ee-9b54-d913189df4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fcd6e9d-5c4d-49ee-9b54-d913189df4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (620aa9de-aa3d-493a-bfbf-c627090e03dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (620aa9de-aa3d-493a-bfbf-c627090e03dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59dd4917-3487-4933-8e59-9adce1652737', 'volume_name': 'volume-59dd4917-3487-4933-8e59-9adce1652737', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f17ba900-a1f9-4014-ada7-e4793652f8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f17ba900-a1f9-4014-ada7-e4793652f8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed667817-061e-48de-9c32-1881b36814b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:35 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] Volume 59dd4917-3487-4933-8e59-9adce1652737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59dd4917-3487-4933-8e59-9adce1652737', 'volume_size': 1} Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-72498673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59dd4917-3487-4933-8e59-9adce1652737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f580950931479a97ae84b6a964fd69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:35Z,use_quota=True,user_id='2f23b34ca87d4f76ad78b093a58bc892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] Creating volume 59dd4917-3487-4933-8e59-9adce1652737 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:35 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:35 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737 1073741824 Sep 01 02:17:35 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-6a85ee37-e924-4151-85aa-fc53b4a231d0 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Created reservations ['c9276ccf-f4db-414c-ae11-5aaaf1d98ceb', '17281a27-cd67-4c9d-96ea-4de260721729', '63881377-ab89-40ab-9a1a-bf5185fedbad', '1acaa26a-48df-47b0-bb9a-c383a523ec9f'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6a85ee37-e924-4151-85aa-fc53b4a231d0 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6a85ee37-e924-4151-85aa-fc53b4a231d0 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-6a85ee37-e924-4151-85aa-fc53b4a231d0 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-6a85ee37-e924-4151-85aa-fc53b4a231d0 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6a85ee37-e924-4151-85aa-fc53b4a231d0 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6a85ee37-e924-4151-85aa-fc53b4a231d0 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:35 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:17:35 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:35 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6a85ee37-e924-4151-85aa-fc53b4a231d0 tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.336s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-6a85ee37-e924-4151-85aa-fc53b4a231d0 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:35 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-6a85ee37-e924-4151-85aa-fc53b4a231d0 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Deleted volume successfully. Sep 01 02:17:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6a85ee37-e924-4151-85aa-fc53b4a231d0 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "cinder-7b1766b6-9ef7-43f1-9207-00d8bcff760b-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:36 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737 1073741824" returned: 0 in 0.753s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:36 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737 Sep 01 02:17:36 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b30945b0-ed11-4724-a332-57c4e910c515 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "cinder-e037f2a0-2dd5-4cb2-bdc3-58359fa27f07-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:36 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b30945b0-ed11-4724-a332-57c4e910c515 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "cinder-e037f2a0-2dd5-4cb2-bdc3-58359fa27f07-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737" returned: 0 in 0.360s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:36 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed667817-061e-48de-9c32-1881b36814b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59dd4917-3487-4933-8e59-9adce1652737', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb317a2-29d1-413c-93f2-aa6a03760125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b30945b0-ed11-4724-a332-57c4e910c515 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "cinder-quobyte-e037f2a0-2dd5-4cb2-bdc3-58359fa27f07" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:36 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] Volume volume-59dd4917-3487-4933-8e59-9adce1652737 (59dd4917-3487-4933-8e59-9adce1652737): created successfully Sep 01 02:17:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb317a2-29d1-413c-93f2-aa6a03760125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] Flow 'volume_create_manager' (0dfa7f6b-55e0-4c45-a409-c898ac7e9f43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:36 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-3127b2c9-a926-4229-9296-3500396b4514 tempest-VolumeDependencyTests-1215626838 None] Created volume successfully. Sep 01 02:17:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b30945b0-ed11-4724-a332-57c4e910c515 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "cinder-quobyte-e037f2a0-2dd5-4cb2-bdc3-58359fa27f07" acquired by "delete_volume" :: waited 0.035s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:36 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16947e2-fd1e-4d98-9e84-5b14361f5c6f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b30945b0-ed11-4724-a332-57c4e910c515 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e037f2a0-2dd5-4cb2-bdc3-58359fa27f07 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:36 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e037f2a0-2dd5-4cb2-bdc3-58359fa27f07 Sep 01 02:17:36 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:37 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b30945b0-ed11-4724-a332-57c4e910c515 tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e037f2a0-2dd5-4cb2-bdc3-58359fa27f07" returned: 0 in 0.472s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b30945b0-ed11-4724-a332-57c4e910c515 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e037f2a0-2dd5-4cb2-bdc3-58359fa27f07 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:37 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e037f2a0-2dd5-4cb2-bdc3-58359fa27f07 Sep 01 02:17:37 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:37 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b30945b0-ed11-4724-a332-57c4e910c515 tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e037f2a0-2dd5-4cb2-bdc3-58359fa27f07" returned: 0 in 0.340s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:37 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b30945b0-ed11-4724-a332-57c4e910c515 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "cinder-quobyte-e037f2a0-2dd5-4cb2-bdc3-58359fa27f07" released by "delete_volume" :: held 0.882s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-69cba881-a109-45fb-bec6-1114d950814a tempest-VolumeDependencyTests-1215626838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-69cba881-a109-45fb-bec6-1114d950814a tempest-VolumeDependencyTests-1215626838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:37 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-69cba881-a109-45fb-bec6-1114d950814a tempest-VolumeDependencyTests-1215626838 None] Creating offline snapshot 81e0142a-4908-46d6-899e-dfc79f8b553a of volume 59dd4917-3487-4933-8e59-9adce1652737 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:17:37 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[38061add-2434-4ec2-be5d-69aa57e681e3]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-69cba881-a109-45fb-bec6-1114d950814a tempest-VolumeDependencyTests-1215626838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:37 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-b30945b0-ed11-4724-a332-57c4e910c515 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Created reservations ['44f02015-788a-4f92-ad94-4115011b3622', 'd80df896-44be-49f9-b582-82ff6079581c', '07be7bcd-39d6-44f0-848d-db02a00b4018', '5009527a-89f0-407d-a742-264f0160cd6a'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b30945b0-ed11-4724-a332-57c4e910c515 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b30945b0-ed11-4724-a332-57c4e910c515 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:37 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b30945b0-ed11-4724-a332-57c4e910c515 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:37 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b30945b0-ed11-4724-a332-57c4e910c515 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b30945b0-ed11-4724-a332-57c4e910c515 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b30945b0-ed11-4724-a332-57c4e910c515 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:37 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:17:37 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:37 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737 Sep 01 02:17:37 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:38 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-69cba881-a109-45fb-bec6-1114d950814a tempest-VolumeDependencyTests-1215626838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737" returned: 0 in 0.478s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-69cba881-a109-45fb-bec6-1114d950814a tempest-VolumeDependencyTests-1215626838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737.81e0142a-4908-46d6-899e-dfc79f8b553a 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:38 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b30945b0-ed11-4724-a332-57c4e910c515 tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.389s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:38 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737.81e0142a-4908-46d6-899e-dfc79f8b553a 1G Sep 01 02:17:38 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-b30945b0-ed11-4724-a332-57c4e910c515 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:38 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:38 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-b30945b0-ed11-4724-a332-57c4e910c515 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Deleted volume successfully. Sep 01 02:17:38 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b30945b0-ed11-4724-a332-57c4e910c515 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "cinder-e037f2a0-2dd5-4cb2-bdc3-58359fa27f07-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:38 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] Flow 'volume_create_manager' (959cedfc-c56f-45f8-86f1-893abb4de6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ebee46-2be4-4e31-9b77-20d67d98dd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ebee46-2be4-4e31-9b77-20d67d98dd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c299f188-f7c1-4c89-bdfa-e93f964adb5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef56c3b1730406aa81ede574d643ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:38Z,use_quota=True,user_id='c0aac96dd81d4fe7a7600567a8726db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f21fbb9a-b55f-42a8-8ceb-f21031eba266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f21fbb9a-b55f-42a8-8ceb-f21031eba266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (969513dc-0108-4bef-8d6b-3cdf3498fcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (969513dc-0108-4bef-8d6b-3cdf3498fcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c299f188-f7c1-4c89-bdfa-e93f964adb5f', 'volume_name': 'volume-c299f188-f7c1-4c89-bdfa-e93f964adb5f', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (937917bc-b6b3-42af-b85b-06658786a767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (937917bc-b6b3-42af-b85b-06658786a767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f07e117d-167a-4f66-a625-bfdf4831feeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:38 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] Volume c299f188-f7c1-4c89-bdfa-e93f964adb5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c299f188-f7c1-4c89-bdfa-e93f964adb5f', 'volume_size': 1} Sep 01 02:17:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:38 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-69cba881-a109-45fb-bec6-1114d950814a tempest-VolumeDependencyTests-1215626838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737.81e0142a-4908-46d6-899e-dfc79f8b553a 1G" returned: 0 in 0.494s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-69cba881-a109-45fb-bec6-1114d950814a tempest-VolumeDependencyTests-1215626838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59dd4917-3487-4933-8e59-9adce1652737 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737.81e0142a-4908-46d6-899e-dfc79f8b553a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:38 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59dd4917-3487-4933-8e59-9adce1652737 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737.81e0142a-4908-46d6-899e-dfc79f8b553a Sep 01 02:17:38 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:38 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-16ca0ace-2b68-4f92-9c96-861df3b95c01 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "cinder-cd9a5827-8ed1-433c-a07c-4fa88ce75d57-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:38 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-16ca0ace-2b68-4f92-9c96-861df3b95c01 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "cinder-cd9a5827-8ed1-433c-a07c-4fa88ce75d57-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:38 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-16ca0ace-2b68-4f92-9c96-861df3b95c01 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "cinder-quobyte-cd9a5827-8ed1-433c-a07c-4fa88ce75d57" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:38 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-16ca0ace-2b68-4f92-9c96-861df3b95c01 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "cinder-quobyte-cd9a5827-8ed1-433c-a07c-4fa88ce75d57" acquired by "delete_volume" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:38 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[81090e94-c912-4b2b-abd4-bdd6cf7cf859]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-16ca0ace-2b68-4f92-9c96-861df3b95c01 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd9a5827-8ed1-433c-a07c-4fa88ce75d57 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:38 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-69cba881-a109-45fb-bec6-1114d950814a tempest-VolumeDependencyTests-1215626838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59dd4917-3487-4933-8e59-9adce1652737 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737.81e0142a-4908-46d6-899e-dfc79f8b553a" returned: 0 in 0.333s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:38 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-69cba881-a109-45fb-bec6-1114d950814a tempest-VolumeDependencyTests-1215626838 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737.81e0142a-4908-46d6-899e-dfc79f8b553a is being set with open permissions: ugo+rw Sep 01 02:17:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-69cba881-a109-45fb-bec6-1114d950814a tempest-VolumeDependencyTests-1215626838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737.81e0142a-4908-46d6-899e-dfc79f8b553a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:38 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737.81e0142a-4908-46d6-899e-dfc79f8b553a Sep 01 02:17:38 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:39 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd9a5827-8ed1-433c-a07c-4fa88ce75d57 Sep 01 02:17:39 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:39 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-69cba881-a109-45fb-bec6-1114d950814a tempest-VolumeDependencyTests-1215626838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737.81e0142a-4908-46d6-899e-dfc79f8b553a" returned: 0 in 0.300s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-69cba881-a109-45fb-bec6-1114d950814a tempest-VolumeDependencyTests-1215626838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:39 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737.info Sep 01 02:17:39 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:39 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-16ca0ace-2b68-4f92-9c96-861df3b95c01 tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd9a5827-8ed1-433c-a07c-4fa88ce75d57" returned: 0 in 0.449s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-16ca0ace-2b68-4f92-9c96-861df3b95c01 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd9a5827-8ed1-433c-a07c-4fa88ce75d57 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:39 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd9a5827-8ed1-433c-a07c-4fa88ce75d57 Sep 01 02:17:39 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:39 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-69cba881-a109-45fb-bec6-1114d950814a tempest-VolumeDependencyTests-1215626838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737.info" returned: 0 in 0.303s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:39 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-69cba881-a109-45fb-bec6-1114d950814a tempest-VolumeDependencyTests-1215626838 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737.info is being set with open permissions: ugo+rw Sep 01 02:17:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-69cba881-a109-45fb-bec6-1114d950814a tempest-VolumeDependencyTests-1215626838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:39 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737.info Sep 01 02:17:39 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:39 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-16ca0ace-2b68-4f92-9c96-861df3b95c01 tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cd9a5827-8ed1-433c-a07c-4fa88ce75d57" returned: 0 in 0.302s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:39 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-16ca0ace-2b68-4f92-9c96-861df3b95c01 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "cinder-quobyte-cd9a5827-8ed1-433c-a07c-4fa88ce75d57" released by "delete_volume" :: held 0.814s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:39 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-16ca0ace-2b68-4f92-9c96-861df3b95c01 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Created reservations ['82ccb467-eab7-498c-9051-d85954dc02f3', '5aceb52f-6b4e-43a4-84a5-dacd6e6cbe58', '24378ff1-0dfd-4ae7-bfd2-09b67b7aa64a', '8bbfd649-c63e-4316-8a23-6012f529a395'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-16ca0ace-2b68-4f92-9c96-861df3b95c01 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-16ca0ace-2b68-4f92-9c96-861df3b95c01 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:39 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-16ca0ace-2b68-4f92-9c96-861df3b95c01 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:39 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-16ca0ace-2b68-4f92-9c96-861df3b95c01 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-16ca0ace-2b68-4f92-9c96-861df3b95c01 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-16ca0ace-2b68-4f92-9c96-861df3b95c01 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:39 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:17:39 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:39 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-69cba881-a109-45fb-bec6-1114d950814a tempest-VolumeDependencyTests-1215626838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737.info" returned: 0 in 0.380s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-69cba881-a109-45fb-bec6-1114d950814a tempest-VolumeDependencyTests-1215626838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.457s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.560s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:40 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c299f188-f7c1-4c89-bdfa-e93f964adb5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef56c3b1730406aa81ede574d643ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:38Z,use_quota=True,user_id='c0aac96dd81d4fe7a7600567a8726db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:40 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] Creating volume c299f188-f7c1-4c89-bdfa-e93f964adb5f {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:40 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:40 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:40 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:40 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:17:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c299f188-f7c1-4c89-bdfa-e93f964adb5f 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:40 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2949f8f0-f804-49c3-b6a1-7a4be4aac36d tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "cinder-f5261779-191b-4dc2-a426-a5bd1537333b-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:40 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c299f188-f7c1-4c89-bdfa-e93f964adb5f 1073741824 Sep 01 02:17:40 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:40 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2949f8f0-f804-49c3-b6a1-7a4be4aac36d tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "cinder-f5261779-191b-4dc2-a426-a5bd1537333b-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:40 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-69cba881-a109-45fb-bec6-1114d950814a tempest-VolumeDependencyTests-1215626838 None] Create snapshot completed successfully Sep 01 02:17:40 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2949f8f0-f804-49c3-b6a1-7a4be4aac36d tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "cinder-quobyte-f5261779-191b-4dc2-a426-a5bd1537333b" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:40 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2949f8f0-f804-49c3-b6a1-7a4be4aac36d tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "cinder-quobyte-f5261779-191b-4dc2-a426-a5bd1537333b" acquired by "delete_volume" :: waited 0.021s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:40 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[009f2523-82b5-4761-a9d6-f2d14386eda4]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2949f8f0-f804-49c3-b6a1-7a4be4aac36d tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f5261779-191b-4dc2-a426-a5bd1537333b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:40 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-16ca0ace-2b68-4f92-9c96-861df3b95c01 tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.466s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:40 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-16ca0ace-2b68-4f92-9c96-861df3b95c01 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:40 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-16ca0ace-2b68-4f92-9c96-861df3b95c01 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Deleted volume successfully. Sep 01 02:17:40 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-16ca0ace-2b68-4f92-9c96-861df3b95c01 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "cinder-cd9a5827-8ed1-433c-a07c-4fa88ce75d57-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:40 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f5261779-191b-4dc2-a426-a5bd1537333b Sep 01 02:17:40 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:40 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2949f8f0-f804-49c3-b6a1-7a4be4aac36d tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f5261779-191b-4dc2-a426-a5bd1537333b" returned: 0 in 0.458s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2949f8f0-f804-49c3-b6a1-7a4be4aac36d tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f5261779-191b-4dc2-a426-a5bd1537333b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:40 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f5261779-191b-4dc2-a426-a5bd1537333b Sep 01 02:17:40 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:40 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c299f188-f7c1-4c89-bdfa-e93f964adb5f 1073741824" returned: 0 in 0.836s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c299f188-f7c1-4c89-bdfa-e93f964adb5f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:40 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c299f188-f7c1-4c89-bdfa-e93f964adb5f Sep 01 02:17:40 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:41 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2949f8f0-f804-49c3-b6a1-7a4be4aac36d tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-f5261779-191b-4dc2-a426-a5bd1537333b" returned: 0 in 0.310s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2949f8f0-f804-49c3-b6a1-7a4be4aac36d tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "cinder-quobyte-f5261779-191b-4dc2-a426-a5bd1537333b" released by "delete_volume" :: held 0.821s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-2949f8f0-f804-49c3-b6a1-7a4be4aac36d tempest-CreateVolumesFromSnapshotTest-1727005056 None] Created reservations ['7c678e45-c142-4972-b5f0-9b6343bf4f90', 'b4cc0d5c-2fb9-432f-a269-876a66c56efc', 'd31d709b-30d1-4dd6-bdda-09954535aaef', 'e8b49015-7656-4d73-93fb-2888c79c5cca'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:41 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c299f188-f7c1-4c89-bdfa-e93f964adb5f" returned: 0 in 0.332s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f07e117d-167a-4f66-a625-bfdf4831feeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c299f188-f7c1-4c89-bdfa-e93f964adb5f', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f54e12-ca74-4223-9561-118436986fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2949f8f0-f804-49c3-b6a1-7a4be4aac36d tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2949f8f0-f804-49c3-b6a1-7a4be4aac36d tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2949f8f0-f804-49c3-b6a1-7a4be4aac36d tempest-CreateVolumesFromSnapshotTest-1727005056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2949f8f0-f804-49c3-b6a1-7a4be4aac36d tempest-CreateVolumesFromSnapshotTest-1727005056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2949f8f0-f804-49c3-b6a1-7a4be4aac36d tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2949f8f0-f804-49c3-b6a1-7a4be4aac36d tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:41 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] Volume volume-c299f188-f7c1-4c89-bdfa-e93f964adb5f (c299f188-f7c1-4c89-bdfa-e93f964adb5f): created successfully Sep 01 02:17:41 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:17:41 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f54e12-ca74-4223-9561-118436986fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] Flow 'volume_create_manager' (959cedfc-c56f-45f8-86f1-893abb4de6ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-39d4180a-9d95-491e-b92c-eae35cd0d516 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "cinder-a16ecdbf-6f49-47ee-9516-4e1287ec5f57-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:41 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-bc9f3d84-4d17-458f-8dd0-6947ea0f2d0b tempest-CinderUnicodeTest-1726310390 None] Created volume successfully. Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-39d4180a-9d95-491e-b92c-eae35cd0d516 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "cinder-a16ecdbf-6f49-47ee-9516-4e1287ec5f57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-39d4180a-9d95-491e-b92c-eae35cd0d516 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "cinder-quobyte-a573ffae-eda5-4b45-852a-e301d4ef2a0f" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-39d4180a-9d95-491e-b92c-eae35cd0d516 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "cinder-quobyte-a573ffae-eda5-4b45-852a-e301d4ef2a0f" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-39d4180a-9d95-491e-b92c-eae35cd0d516 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "cinder-quobyte-a16ecdbf-6f49-47ee-9516-4e1287ec5f57" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Flow 'volume_create_manager' (2fcddbb9-d6b9-405a-9342-74d29c058d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebed0545-3c78-4c44-b86e-0487b9fc4836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-39d4180a-9d95-491e-b92c-eae35cd0d516 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "cinder-quobyte-a16ecdbf-6f49-47ee-9516-4e1287ec5f57" acquired by "_delete_snapshot" :: waited 0.069s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-39d4180a-9d95-491e-b92c-eae35cd0d516 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Deleting offline snapshot a16ecdbf-6f49-47ee-9516-4e1287ec5f57 of volume a573ffae-eda5-4b45-852a-e301d4ef2a0f {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-39d4180a-9d95-491e-b92c-eae35cd0d516 tempest-CreateVolumesFromSnapshotTest-1727005056 None] snapshot_file for this snap is: volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f.a16ecdbf-6f49-47ee-9516-4e1287ec5f57 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebed0545-3c78-4c44-b86e-0487b9fc4836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-276317149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e9202b-9ed3-4f48-a0c6-c452b13f30ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f580950931479a97ae84b6a964fd69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=81e0142a-4908-46d6-899e-dfc79f8b553a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:41Z,use_quota=True,user_id='2f23b34ca87d4f76ad78b093a58bc892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c798adc2-6155-4eb6-957a-3b0c5ce9f66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c798adc2-6155-4eb6-957a-3b0c5ce9f66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:41 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fba1484-6be7-481e-a24a-5a9a76b61f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fba1484-6be7-481e-a24a-5a9a76b61f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c7e9202b-9ed3-4f48-a0c6-c452b13f30ff', 'volume_name': 'volume-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff', 'volume_size': 1, 'snapshot_id': '81e0142a-4908-46d6-899e-dfc79f8b553a'}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc9c01c-5aac-44d1-9650-70d0efd690cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc9c01c-5aac-44d1-9650-70d0efd690cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa5de26-ddfb-4e9f-8dee-d9503cf72d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:41 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Volume c7e9202b-9ed3-4f48-a0c6-c452b13f30ff: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff', 'volume_size': 1, 'snapshot_id': '81e0142a-4908-46d6-899e-dfc79f8b553a'} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e1a391-8147-4dda-a70c-65c0f45629bf]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-39d4180a-9d95-491e-b92c-eae35cd0d516 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f.a16ecdbf-6f49-47ee-9516-4e1287ec5f57 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2949f8f0-f804-49c3-b6a1-7a4be4aac36d tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.365s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-2949f8f0-f804-49c3-b6a1-7a4be4aac36d tempest-CreateVolumesFromSnapshotTest-1727005056 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:41 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-2949f8f0-f804-49c3-b6a1-7a4be4aac36d tempest-CreateVolumesFromSnapshotTest-1727005056 None] Deleted volume successfully. Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Acquiring lock "cinder-quobyte-81e0142a-4908-46d6-899e-dfc79f8b553a-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff" by "_create_volume_from_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Lock "cinder-quobyte-81e0142a-4908-46d6-899e-dfc79f8b553a-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Creating volume c7e9202b-9ed3-4f48-a0c6-c452b13f30ff from snapshot 81e0142a-4908-46d6-899e-dfc79f8b553a {{(pid=87128) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Acquiring lock "cinder-quobyte-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff" by "_copy_volume_from_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2949f8f0-f804-49c3-b6a1-7a4be4aac36d tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "cinder-f5261779-191b-4dc2-a426-a5bd1537333b-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Lock "cinder-quobyte-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] snapshot: 81e0142a-4908-46d6-899e-dfc79f8b553a, volume: c7e9202b-9ed3-4f48-a0c6-c452b13f30ff, {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:41 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f.a16ecdbf-6f49-47ee-9516-4e1287ec5f57 Sep 01 02:17:41 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1445769-5a52-4ade-ba50-6b07a52d029c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737.81e0142a-4908-46d6-899e-dfc79f8b553a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:42 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737.81e0142a-4908-46d6-899e-dfc79f8b553a Sep 01 02:17:42 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:42 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-39d4180a-9d95-491e-b92c-eae35cd0d516 tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f.a16ecdbf-6f49-47ee-9516-4e1287ec5f57" returned: 0 in 0.523s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-39d4180a-9d95-491e-b92c-eae35cd0d516 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:17:42 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c92c86-4df0-4482-9826-8bf3b775e61d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-39d4180a-9d95-491e-b92c-eae35cd0d516 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:42 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:42 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f Sep 01 02:17:42 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] Flow 'volume_create_manager' (1377f923-7881-4e03-b6cd-6a5032e40a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929bcf64-83c4-4432-8aec-84ac09a5d26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929bcf64-83c4-4432-8aec-84ac09a5d26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-324240933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0830345c-7960-40ad-bc6b-3687caaab158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef56c3b1730406aa81ede574d643ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:42Z,use_quota=True,user_id='c0aac96dd81d4fe7a7600567a8726db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1407f44e-4e62-4248-bb97-5fa220bb8d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:42 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1407f44e-4e62-4248-bb97-5fa220bb8d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42095c67-5ffb-41a5-b7dd-bbc3b17bf362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42095c67-5ffb-41a5-b7dd-bbc3b17bf362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0830345c-7960-40ad-bc6b-3687caaab158', 'volume_name': 'volume-0830345c-7960-40ad-bc6b-3687caaab158', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90bf3cc1-d755-4ce5-9f4e-c30fcc2e2c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90bf3cc1-d755-4ce5-9f4e-c30fcc2e2c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd26b04-cc69-4775-942e-567c20563cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:42 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] Volume 0830345c-7960-40ad-bc6b-3687caaab158: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0830345c-7960-40ad-bc6b-3687caaab158', 'volume_size': 1} Sep 01 02:17:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737.81e0142a-4908-46d6-899e-dfc79f8b553a" returned: 0 in 0.611s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59dd4917-3487-4933-8e59-9adce1652737(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:17:42 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[76437c5c-a84b-4f96-b346-dd1249ed9cec]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:42 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737 Sep 01 02:17:42 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:42 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-39d4180a-9d95-491e-b92c-eae35cd0d516 tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f" returned: 0 in 0.445s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-39d4180a-9d95-491e-b92c-eae35cd0d516 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f.a16ecdbf-6f49-47ee-9516-4e1287ec5f57 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:42 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f.a16ecdbf-6f49-47ee-9516-4e1287ec5f57 Sep 01 02:17:42 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:42 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737" returned: 0 in 0.433s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737 {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:17:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Creating direct copy from snapshot {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:17:42 devstack cinder-volume[87128]: DEBUG cinder.utils [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Path /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff not found in is_blk_device check {{(pid=87128) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:17:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:42 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff Sep 01 02:17:42 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:43 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-39d4180a-9d95-491e-b92c-eae35cd0d516 tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f.a16ecdbf-6f49-47ee-9516-4e1287ec5f57" returned: 0 in 0.451s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-39d4180a-9d95-491e-b92c-eae35cd0d516 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f.a16ecdbf-6f49-47ee-9516-4e1287ec5f57 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:43 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f.a16ecdbf-6f49-47ee-9516-4e1287ec5f57 Sep 01 02:17:43 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:43 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-39d4180a-9d95-491e-b92c-eae35cd0d516 tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f.a16ecdbf-6f49-47ee-9516-4e1287ec5f57" returned: 0 in 0.275s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:43 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-39d4180a-9d95-491e-b92c-eae35cd0d516 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "cinder-quobyte-a16ecdbf-6f49-47ee-9516-4e1287ec5f57" released by "_delete_snapshot" :: held 1.897s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:43 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-39d4180a-9d95-491e-b92c-eae35cd0d516 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "cinder-quobyte-a573ffae-eda5-4b45-852a-e301d4ef2a0f" released by "delete_snapshot" :: held 1.989s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:43 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-39d4180a-9d95-491e-b92c-eae35cd0d516 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Created reservations ['8885783d-4aab-4663-b955-9e3fcc31bb4b', 'c27f0b91-8d79-4af0-b3f8-b972c7b26849', '4e1e2296-6ff9-4e40-8ca6-f514111d5bd6', '38650b7e-94d4-4194-b978-b10dd50aaa00'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:43 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-39d4180a-9d95-491e-b92c-eae35cd0d516 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Delete snapshot completed successfully. Sep 01 02:17:43 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-39d4180a-9d95-491e-b92c-eae35cd0d516 tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "cinder-a16ecdbf-6f49-47ee-9516-4e1287ec5f57-delete_snapshot" released by "delete_snapshot" :: held 2.349s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:44 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4828aa79-4a7b-442e-99ce-88713e7a3fbf tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "cinder-a573ffae-eda5-4b45-852a-e301d4ef2a0f-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:44 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4828aa79-4a7b-442e-99ce-88713e7a3fbf tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "cinder-a573ffae-eda5-4b45-852a-e301d4ef2a0f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:44 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4828aa79-4a7b-442e-99ce-88713e7a3fbf tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "cinder-quobyte-a573ffae-eda5-4b45-852a-e301d4ef2a0f" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:45 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4828aa79-4a7b-442e-99ce-88713e7a3fbf tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "cinder-quobyte-a573ffae-eda5-4b45-852a-e301d4ef2a0f" acquired by "delete_volume" :: waited 0.065s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:45 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[8044ecff-4556-420f-9a52-0dcaabc243b0]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4828aa79-4a7b-442e-99ce-88713e7a3fbf tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:45 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f Sep 01 02:17:45 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:46 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4828aa79-4a7b-442e-99ce-88713e7a3fbf tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f" returned: 0 in 1.132s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4828aa79-4a7b-442e-99ce-88713e7a3fbf tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:46 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f Sep 01 02:17:46 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:46 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4828aa79-4a7b-442e-99ce-88713e7a3fbf tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-a573ffae-eda5-4b45-852a-e301d4ef2a0f" returned: 0 in 0.608s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:47 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4828aa79-4a7b-442e-99ce-88713e7a3fbf tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "cinder-quobyte-a573ffae-eda5-4b45-852a-e301d4ef2a0f" released by "delete_volume" :: held 1.946s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:47 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-4828aa79-4a7b-442e-99ce-88713e7a3fbf tempest-CreateVolumesFromSnapshotTest-1727005056 None] Created reservations ['2610df92-bef7-4995-8910-3b6a211d384e', '94e3042f-d5dd-4915-a505-9458467dbdd5', 'c2facaa5-82de-4a48-ab7f-d91eeab48574', '029833a2-50c8-4826-9793-d464ac87c64e'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4828aa79-4a7b-442e-99ce-88713e7a3fbf tempest-CreateVolumesFromSnapshotTest-1727005056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4828aa79-4a7b-442e-99ce-88713e7a3fbf tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:47 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4828aa79-4a7b-442e-99ce-88713e7a3fbf tempest-CreateVolumesFromSnapshotTest-1727005056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:47 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4828aa79-4a7b-442e-99ce-88713e7a3fbf tempest-CreateVolumesFromSnapshotTest-1727005056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4828aa79-4a7b-442e-99ce-88713e7a3fbf tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4828aa79-4a7b-442e-99ce-88713e7a3fbf tempest-CreateVolumesFromSnapshotTest-1727005056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:47 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:17:47 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:47 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4828aa79-4a7b-442e-99ce-88713e7a3fbf tempest-CreateVolumesFromSnapshotTest-1727005056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.542s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:47 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-4828aa79-4a7b-442e-99ce-88713e7a3fbf tempest-CreateVolumesFromSnapshotTest-1727005056 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:47 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-4828aa79-4a7b-442e-99ce-88713e7a3fbf tempest-CreateVolumesFromSnapshotTest-1727005056 None] Deleted volume successfully. Sep 01 02:17:48 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-4828aa79-4a7b-442e-99ce-88713e7a3fbf tempest-CreateVolumesFromSnapshotTest-1727005056 None] Lock "cinder-a573ffae-eda5-4b45-852a-e301d4ef2a0f-delete_volume" released by "delete_volume" :: held 3.116s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:48 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff" returned: 0 in 5.337s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:48 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737, size 1024.00 MB, duration 5.34 sec, destination /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff {{(pid=87128) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:17:48 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Converted 1024.00 MB image at 191.80 MB/s Sep 01 02:17:48 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff is being set with open permissions: ugo+rw Sep 01 02:17:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:48 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff Sep 01 02:17:48 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:48 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff" returned: 0 in 0.291s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:48 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Lock "cinder-quobyte-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff" released by "_copy_volume_from_snapshot" :: held 6.806s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:48 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Lock "cinder-quobyte-81e0142a-4908-46d6-899e-dfc79f8b553a-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff" released by "_create_volume_from_snapshot" :: held 6.892s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.918s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.152s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:48 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-324240933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0830345c-7960-40ad-bc6b-3687caaab158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef56c3b1730406aa81ede574d643ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:42Z,use_quota=True,user_id='c0aac96dd81d4fe7a7600567a8726db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:48 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] Creating volume 0830345c-7960-40ad-bc6b-3687caaab158 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:48 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:48 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:48 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:48 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:17:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:48 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158 1073741824 Sep 01 02:17:48 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:48 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa5de26-ddfb-4e9f-8dee-d9503cf72d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff', 'volume_size': 1, 'snapshot_id': '81e0142a-4908-46d6-899e-dfc79f8b553a'}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:48 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (388a537c-31df-47bb-929c-f157613c066f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:48 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Volume volume-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff (c7e9202b-9ed3-4f48-a0c6-c452b13f30ff): created successfully Sep 01 02:17:48 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (388a537c-31df-47bb-929c-f157613c066f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:48 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Flow 'volume_create_manager' (2fcddbb9-d6b9-405a-9342-74d29c058d63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:48 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-e30ba5bc-e9a9-4b7f-8c3c-a69560c5f6ff tempest-VolumeDependencyTests-1215626838 None] Created volume successfully. Sep 01 02:17:49 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158 1073741824" returned: 0 in 0.556s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:49 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158 Sep 01 02:17:49 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3a2a385e-db89-4d39-8ecd-80af253a4d8a tempest-VolumeDependencyTests-1215626838 None] Acquiring lock "cinder-81e0142a-4908-46d6-899e-dfc79f8b553a-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3a2a385e-db89-4d39-8ecd-80af253a4d8a tempest-VolumeDependencyTests-1215626838 None] Lock "cinder-81e0142a-4908-46d6-899e-dfc79f8b553a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3a2a385e-db89-4d39-8ecd-80af253a4d8a tempest-VolumeDependencyTests-1215626838 None] Acquiring lock "cinder-quobyte-59dd4917-3487-4933-8e59-9adce1652737" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3a2a385e-db89-4d39-8ecd-80af253a4d8a tempest-VolumeDependencyTests-1215626838 None] Lock "cinder-quobyte-59dd4917-3487-4933-8e59-9adce1652737" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3a2a385e-db89-4d39-8ecd-80af253a4d8a tempest-VolumeDependencyTests-1215626838 None] Acquiring lock "cinder-quobyte-81e0142a-4908-46d6-899e-dfc79f8b553a" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3a2a385e-db89-4d39-8ecd-80af253a4d8a tempest-VolumeDependencyTests-1215626838 None] Lock "cinder-quobyte-81e0142a-4908-46d6-899e-dfc79f8b553a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-3a2a385e-db89-4d39-8ecd-80af253a4d8a tempest-VolumeDependencyTests-1215626838 None] Deleting offline snapshot 81e0142a-4908-46d6-899e-dfc79f8b553a of volume 59dd4917-3487-4933-8e59-9adce1652737 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:17:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-3a2a385e-db89-4d39-8ecd-80af253a4d8a tempest-VolumeDependencyTests-1215626838 None] snapshot_file for this snap is: volume-59dd4917-3487-4933-8e59-9adce1652737.81e0142a-4908-46d6-899e-dfc79f8b553a {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:17:49 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[71370f00-f94c-47f7-88c6-1aefcf64a20b]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3a2a385e-db89-4d39-8ecd-80af253a4d8a tempest-VolumeDependencyTests-1215626838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737.81e0142a-4908-46d6-899e-dfc79f8b553a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:49 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158" returned: 0 in 0.343s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd26b04-cc69-4775-942e-567c20563cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0830345c-7960-40ad-bc6b-3687caaab158', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (850f3e0e-6615-425b-8bfd-789ce798c983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:49 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] Volume volume-0830345c-7960-40ad-bc6b-3687caaab158 (0830345c-7960-40ad-bc6b-3687caaab158): created successfully Sep 01 02:17:49 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737.81e0142a-4908-46d6-899e-dfc79f8b553a Sep 01 02:17:49 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (850f3e0e-6615-425b-8bfd-789ce798c983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] Flow 'volume_create_manager' (1377f923-7881-4e03-b6cd-6a5032e40a32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:49 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-fa3010ea-9971-4d56-b70a-087c9d093e1e tempest-CinderUnicodeTest-1726310390 None] Created volume successfully. Sep 01 02:17:49 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3a2a385e-db89-4d39-8ecd-80af253a4d8a tempest-VolumeDependencyTests-1215626838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737.81e0142a-4908-46d6-899e-dfc79f8b553a" returned: 0 in 0.450s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-3a2a385e-db89-4d39-8ecd-80af253a4d8a tempest-VolumeDependencyTests-1215626838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59dd4917-3487-4933-8e59-9adce1652737(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:17:49 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0662748-5e76-46e0-b1f2-25d5d73e847e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3a2a385e-db89-4d39-8ecd-80af253a4d8a tempest-VolumeDependencyTests-1215626838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:50 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737 Sep 01 02:17:50 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0d19b224-66bf-44e3-b2e0-6b333455e5aa tempest-CinderUnicodeTest-1726310390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0d19b224-66bf-44e3-b2e0-6b333455e5aa tempest-CinderUnicodeTest-1726310390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:50 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-0d19b224-66bf-44e3-b2e0-6b333455e5aa tempest-CinderUnicodeTest-1726310390 None] Creating offline snapshot 749273e9-98e3-45c9-9579-db169edbcc56 of volume 0830345c-7960-40ad-bc6b-3687caaab158 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:17:50 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[b543cf50-b1f1-4b11-b2b8-98e538b3550f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0d19b224-66bf-44e3-b2e0-6b333455e5aa tempest-CinderUnicodeTest-1726310390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:50 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158 Sep 01 02:17:50 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:50 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3a2a385e-db89-4d39-8ecd-80af253a4d8a tempest-VolumeDependencyTests-1215626838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737" returned: 0 in 0.896s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3a2a385e-db89-4d39-8ecd-80af253a4d8a tempest-VolumeDependencyTests-1215626838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737.81e0142a-4908-46d6-899e-dfc79f8b553a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:50 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737.81e0142a-4908-46d6-899e-dfc79f8b553a Sep 01 02:17:50 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:51 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0d19b224-66bf-44e3-b2e0-6b333455e5aa tempest-CinderUnicodeTest-1726310390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158" returned: 0 in 0.600s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0d19b224-66bf-44e3-b2e0-6b333455e5aa tempest-CinderUnicodeTest-1726310390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158.749273e9-98e3-45c9-9579-db169edbcc56 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:51 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158.749273e9-98e3-45c9-9579-db169edbcc56 1G Sep 01 02:17:51 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:51 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3a2a385e-db89-4d39-8ecd-80af253a4d8a tempest-VolumeDependencyTests-1215626838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737.81e0142a-4908-46d6-899e-dfc79f8b553a" returned: 0 in 0.448s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3a2a385e-db89-4d39-8ecd-80af253a4d8a tempest-VolumeDependencyTests-1215626838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737.81e0142a-4908-46d6-899e-dfc79f8b553a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:51 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737.81e0142a-4908-46d6-899e-dfc79f8b553a Sep 01 02:17:51 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:51 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3a2a385e-db89-4d39-8ecd-80af253a4d8a tempest-VolumeDependencyTests-1215626838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737.81e0142a-4908-46d6-899e-dfc79f8b553a" returned: 0 in 0.387s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3a2a385e-db89-4d39-8ecd-80af253a4d8a tempest-VolumeDependencyTests-1215626838 None] Lock "cinder-quobyte-81e0142a-4908-46d6-899e-dfc79f8b553a" released by "_delete_snapshot" :: held 2.340s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3a2a385e-db89-4d39-8ecd-80af253a4d8a tempest-VolumeDependencyTests-1215626838 None] Lock "cinder-quobyte-59dd4917-3487-4933-8e59-9adce1652737" released by "delete_snapshot" :: held 2.375s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:51 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-3a2a385e-db89-4d39-8ecd-80af253a4d8a tempest-VolumeDependencyTests-1215626838 None] Created reservations ['d2f6e623-da09-473a-8a79-76fcf401b0dc', 'd041bc33-1993-47cf-b44c-9965c00025a0', '39a1698f-5d84-45aa-bfa6-ae38971eb556', 'd8f97768-88ba-40bb-991b-774cc6d7c50b'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:51 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-3a2a385e-db89-4d39-8ecd-80af253a4d8a tempest-VolumeDependencyTests-1215626838 None] Delete snapshot completed successfully. Sep 01 02:17:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-3a2a385e-db89-4d39-8ecd-80af253a4d8a tempest-VolumeDependencyTests-1215626838 None] Lock "cinder-81e0142a-4908-46d6-899e-dfc79f8b553a-delete_snapshot" released by "delete_snapshot" :: held 2.608s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:52 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0d19b224-66bf-44e3-b2e0-6b333455e5aa tempest-CinderUnicodeTest-1726310390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158.749273e9-98e3-45c9-9579-db169edbcc56 1G" returned: 0 in 0.756s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0d19b224-66bf-44e3-b2e0-6b333455e5aa tempest-CinderUnicodeTest-1726310390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0830345c-7960-40ad-bc6b-3687caaab158 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158.749273e9-98e3-45c9-9579-db169edbcc56 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:52 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0830345c-7960-40ad-bc6b-3687caaab158 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158.749273e9-98e3-45c9-9579-db169edbcc56 Sep 01 02:17:52 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:52 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Flow 'volume_create_manager' (b4b408c6-f6d3-4273-9678-9da0af99f1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b75c345e-d7ed-41f5-8593-7d54044328d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b75c345e-d7ed-41f5-8593-7d54044328d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1809947371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59bc2523-f0e8-4de5-ae06-1f1b076a81a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c20888cc0edb4d2f8f59a89088c3835c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:52Z,use_quota=True,user_id='9f5a5fc733b24894879b6cf1261b3cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee7bea7c-112c-4d65-a394-5c4d0f77c168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee7bea7c-112c-4d65-a394-5c4d0f77c168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf508533-fedb-41b3-b3e0-c7100202aa1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf508533-fedb-41b3-b3e0-c7100202aa1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59bc2523-f0e8-4de5-ae06-1f1b076a81a1', 'volume_name': 'volume-59bc2523-f0e8-4de5-ae06-1f1b076a81a1', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b710498-e0f4-4dbd-be70-b849ef84f7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b710498-e0f4-4dbd-be70-b849ef84f7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08995260-a93a-46b2-9d73-e7075294cb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:52 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Volume 59bc2523-f0e8-4de5-ae06-1f1b076a81a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59bc2523-f0e8-4de5-ae06-1f1b076a81a1', 'volume_size': 1} Sep 01 02:17:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:52 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0d19b224-66bf-44e3-b2e0-6b333455e5aa tempest-CinderUnicodeTest-1726310390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0830345c-7960-40ad-bc6b-3687caaab158 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158.749273e9-98e3-45c9-9579-db169edbcc56" returned: 0 in 0.517s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:52 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-0d19b224-66bf-44e3-b2e0-6b333455e5aa tempest-CinderUnicodeTest-1726310390 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158.749273e9-98e3-45c9-9579-db169edbcc56 is being set with open permissions: ugo+rw Sep 01 02:17:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0d19b224-66bf-44e3-b2e0-6b333455e5aa tempest-CinderUnicodeTest-1726310390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158.749273e9-98e3-45c9-9579-db169edbcc56 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:52 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158.749273e9-98e3-45c9-9579-db169edbcc56 Sep 01 02:17:52 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0ad0082e-4af0-4254-bd35-9d89e0bea78c tempest-VolumeDependencyTests-1215626838 None] Acquiring lock "cinder-59dd4917-3487-4933-8e59-9adce1652737-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0ad0082e-4af0-4254-bd35-9d89e0bea78c tempest-VolumeDependencyTests-1215626838 None] Lock "cinder-59dd4917-3487-4933-8e59-9adce1652737-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0ad0082e-4af0-4254-bd35-9d89e0bea78c tempest-VolumeDependencyTests-1215626838 None] Acquiring lock "cinder-quobyte-59dd4917-3487-4933-8e59-9adce1652737" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0ad0082e-4af0-4254-bd35-9d89e0bea78c tempest-VolumeDependencyTests-1215626838 None] Lock "cinder-quobyte-59dd4917-3487-4933-8e59-9adce1652737" acquired by "delete_volume" :: waited 0.031s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:52 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af1f18c-14a6-466f-b0d5-d097ec8ca364]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0ad0082e-4af0-4254-bd35-9d89e0bea78c tempest-VolumeDependencyTests-1215626838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:52 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0d19b224-66bf-44e3-b2e0-6b333455e5aa tempest-CinderUnicodeTest-1726310390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158.749273e9-98e3-45c9-9579-db169edbcc56" returned: 0 in 0.412s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0d19b224-66bf-44e3-b2e0-6b333455e5aa tempest-CinderUnicodeTest-1726310390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:53 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737 Sep 01 02:17:53 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:53 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158.info Sep 01 02:17:53 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:53 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0d19b224-66bf-44e3-b2e0-6b333455e5aa tempest-CinderUnicodeTest-1726310390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158.info" returned: 0 in 0.296s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:53 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-0d19b224-66bf-44e3-b2e0-6b333455e5aa tempest-CinderUnicodeTest-1726310390 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158.info is being set with open permissions: ugo+rw Sep 01 02:17:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0d19b224-66bf-44e3-b2e0-6b333455e5aa tempest-CinderUnicodeTest-1726310390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:53 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158.info Sep 01 02:17:53 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:53 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0ad0082e-4af0-4254-bd35-9d89e0bea78c tempest-VolumeDependencyTests-1215626838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737" returned: 0 in 0.514s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0ad0082e-4af0-4254-bd35-9d89e0bea78c tempest-VolumeDependencyTests-1215626838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:53 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737 Sep 01 02:17:53 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:53 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0d19b224-66bf-44e3-b2e0-6b333455e5aa tempest-CinderUnicodeTest-1726310390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158.info" returned: 0 in 0.265s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0d19b224-66bf-44e3-b2e0-6b333455e5aa tempest-CinderUnicodeTest-1726310390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.012s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.097s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1809947371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59bc2523-f0e8-4de5-ae06-1f1b076a81a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c20888cc0edb4d2f8f59a89088c3835c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:52Z,use_quota=True,user_id='9f5a5fc733b24894879b6cf1261b3cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Creating volume 59bc2523-f0e8-4de5-ae06-1f1b076a81a1 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:53 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:17:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59bc2523-f0e8-4de5-ae06-1f1b076a81a1 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:53 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-0d19b224-66bf-44e3-b2e0-6b333455e5aa tempest-CinderUnicodeTest-1726310390 None] Create snapshot completed successfully Sep 01 02:17:53 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59bc2523-f0e8-4de5-ae06-1f1b076a81a1 1073741824 Sep 01 02:17:53 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:53 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0ad0082e-4af0-4254-bd35-9d89e0bea78c tempest-VolumeDependencyTests-1215626838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59dd4917-3487-4933-8e59-9adce1652737" returned: 0 in 0.300s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0ad0082e-4af0-4254-bd35-9d89e0bea78c tempest-VolumeDependencyTests-1215626838 None] Lock "cinder-quobyte-59dd4917-3487-4933-8e59-9adce1652737" released by "delete_volume" :: held 0.928s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:53 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-0ad0082e-4af0-4254-bd35-9d89e0bea78c tempest-VolumeDependencyTests-1215626838 None] Created reservations ['4c85e9a8-d50b-4f30-b00d-68210d69b7ac', '54512579-8358-465a-8dad-63860a87ed88', '3e738df6-2dd8-4337-be68-db4918a6674f', 'bbcb16b4-20f1-4ada-bde2-01097679e8f7'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0ad0082e-4af0-4254-bd35-9d89e0bea78c tempest-VolumeDependencyTests-1215626838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0ad0082e-4af0-4254-bd35-9d89e0bea78c tempest-VolumeDependencyTests-1215626838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0ad0082e-4af0-4254-bd35-9d89e0bea78c tempest-VolumeDependencyTests-1215626838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0ad0082e-4af0-4254-bd35-9d89e0bea78c tempest-VolumeDependencyTests-1215626838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0ad0082e-4af0-4254-bd35-9d89e0bea78c tempest-VolumeDependencyTests-1215626838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0ad0082e-4af0-4254-bd35-9d89e0bea78c tempest-VolumeDependencyTests-1215626838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:53 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:17:53 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:54 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59bc2523-f0e8-4de5-ae06-1f1b076a81a1 1073741824" returned: 0 in 0.475s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59bc2523-f0e8-4de5-ae06-1f1b076a81a1 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:54 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59bc2523-f0e8-4de5-ae06-1f1b076a81a1 Sep 01 02:17:54 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:54 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0ad0082e-4af0-4254-bd35-9d89e0bea78c tempest-VolumeDependencyTests-1215626838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.298s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:54 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-0ad0082e-4af0-4254-bd35-9d89e0bea78c tempest-VolumeDependencyTests-1215626838 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:54 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-0ad0082e-4af0-4254-bd35-9d89e0bea78c tempest-VolumeDependencyTests-1215626838 None] Deleted volume successfully. Sep 01 02:17:54 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0ad0082e-4af0-4254-bd35-9d89e0bea78c tempest-VolumeDependencyTests-1215626838 None] Lock "cinder-59dd4917-3487-4933-8e59-9adce1652737-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:54 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59bc2523-f0e8-4de5-ae06-1f1b076a81a1" returned: 0 in 0.279s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08995260-a93a-46b2-9d73-e7075294cb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59bc2523-f0e8-4de5-ae06-1f1b076a81a1', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (712800b4-647b-4e3f-9f2d-f79d5a473cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:54 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Volume volume-59bc2523-f0e8-4de5-ae06-1f1b076a81a1 (59bc2523-f0e8-4de5-ae06-1f1b076a81a1): created successfully Sep 01 02:17:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (712800b4-647b-4e3f-9f2d-f79d5a473cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Flow 'volume_create_manager' (b4b408c6-f6d3-4273-9678-9da0af99f1fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:54 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-b6a659df-af64-4979-880a-f6ff82bca6f5 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Created volume successfully. Sep 01 02:17:54 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9ed70330-26eb-4f1e-b1c0-3ade691e7825 tempest-CinderUnicodeTest-1726310390 None] Acquiring lock "cinder-749273e9-98e3-45c9-9579-db169edbcc56-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:54 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9ed70330-26eb-4f1e-b1c0-3ade691e7825 tempest-CinderUnicodeTest-1726310390 None] Lock "cinder-749273e9-98e3-45c9-9579-db169edbcc56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:54 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9ed70330-26eb-4f1e-b1c0-3ade691e7825 tempest-CinderUnicodeTest-1726310390 None] Acquiring lock "cinder-quobyte-0830345c-7960-40ad-bc6b-3687caaab158" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:54 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9ed70330-26eb-4f1e-b1c0-3ade691e7825 tempest-CinderUnicodeTest-1726310390 None] Lock "cinder-quobyte-0830345c-7960-40ad-bc6b-3687caaab158" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:54 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9ed70330-26eb-4f1e-b1c0-3ade691e7825 tempest-CinderUnicodeTest-1726310390 None] Acquiring lock "cinder-quobyte-749273e9-98e3-45c9-9579-db169edbcc56" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:54 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9ed70330-26eb-4f1e-b1c0-3ade691e7825 tempest-CinderUnicodeTest-1726310390 None] Lock "cinder-quobyte-749273e9-98e3-45c9-9579-db169edbcc56" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-9ed70330-26eb-4f1e-b1c0-3ade691e7825 tempest-CinderUnicodeTest-1726310390 None] Deleting offline snapshot 749273e9-98e3-45c9-9579-db169edbcc56 of volume 0830345c-7960-40ad-bc6b-3687caaab158 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:17:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-9ed70330-26eb-4f1e-b1c0-3ade691e7825 tempest-CinderUnicodeTest-1726310390 None] snapshot_file for this snap is: volume-0830345c-7960-40ad-bc6b-3687caaab158.749273e9-98e3-45c9-9579-db169edbcc56 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:17:54 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-d2a2ce67-91f8-4659-a593-2623fb2779a3 tempest-VolumeDependencyTests-1215626838 None] Acquiring lock "cinder-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:54 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f0423f-d1ed-4b01-8d6d-43c898c9b372]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9ed70330-26eb-4f1e-b1c0-3ade691e7825 tempest-CinderUnicodeTest-1726310390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158.749273e9-98e3-45c9-9579-db169edbcc56 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:54 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-d2a2ce67-91f8-4659-a593-2623fb2779a3 tempest-VolumeDependencyTests-1215626838 None] Lock "cinder-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:55 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-d2a2ce67-91f8-4659-a593-2623fb2779a3 tempest-VolumeDependencyTests-1215626838 None] Acquiring lock "cinder-quobyte-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:55 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-d2a2ce67-91f8-4659-a593-2623fb2779a3 tempest-VolumeDependencyTests-1215626838 None] Lock "cinder-quobyte-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff" acquired by "delete_volume" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:55 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0be32c-8653-4013-8bb3-ebaf19263c81]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d2a2ce67-91f8-4659-a593-2623fb2779a3 tempest-VolumeDependencyTests-1215626838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:55 devstack sudo[105309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158.749273e9-98e3-45c9-9579-db169edbcc56 Sep 01 02:17:55 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:55 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff Sep 01 02:17:55 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:55 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9ed70330-26eb-4f1e-b1c0-3ade691e7825 tempest-CinderUnicodeTest-1726310390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158.749273e9-98e3-45c9-9579-db169edbcc56" returned: 0 in 0.454s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:55 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-9ed70330-26eb-4f1e-b1c0-3ade691e7825 tempest-CinderUnicodeTest-1726310390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0830345c-7960-40ad-bc6b-3687caaab158(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:17:55 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd29b02-9c9b-4fc1-80f1-f8980e386ba2]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9ed70330-26eb-4f1e-b1c0-3ade691e7825 tempest-CinderUnicodeTest-1726310390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:55 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d2a2ce67-91f8-4659-a593-2623fb2779a3 tempest-VolumeDependencyTests-1215626838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff" returned: 0 in 0.407s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d2a2ce67-91f8-4659-a593-2623fb2779a3 tempest-VolumeDependencyTests-1215626838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:55 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff Sep 01 02:17:55 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:55 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158 Sep 01 02:17:55 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:55 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9ed70330-26eb-4f1e-b1c0-3ade691e7825 tempest-CinderUnicodeTest-1726310390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158" returned: 0 in 0.486s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9ed70330-26eb-4f1e-b1c0-3ade691e7825 tempest-CinderUnicodeTest-1726310390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158.749273e9-98e3-45c9-9579-db169edbcc56 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:55 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d2a2ce67-91f8-4659-a593-2623fb2779a3 tempest-VolumeDependencyTests-1215626838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff" returned: 0 in 0.471s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:55 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158.749273e9-98e3-45c9-9579-db169edbcc56 Sep 01 02:17:55 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-d2a2ce67-91f8-4659-a593-2623fb2779a3 tempest-VolumeDependencyTests-1215626838 None] Lock "cinder-quobyte-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff" released by "delete_volume" :: held 0.937s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-d2a2ce67-91f8-4659-a593-2623fb2779a3 tempest-VolumeDependencyTests-1215626838 None] Created reservations ['947acc56-5df0-43cf-a5bb-cab5df4aaba0', '8995f692-b317-4995-89b5-f55f9d1c07fc', '2713e119-6771-4c66-8156-df4f2fa74e0a', '853cbfda-03eb-4a50-9c97-ef3a670f3a71'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d2a2ce67-91f8-4659-a593-2623fb2779a3 tempest-VolumeDependencyTests-1215626838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d2a2ce67-91f8-4659-a593-2623fb2779a3 tempest-VolumeDependencyTests-1215626838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d2a2ce67-91f8-4659-a593-2623fb2779a3 tempest-VolumeDependencyTests-1215626838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d2a2ce67-91f8-4659-a593-2623fb2779a3 tempest-VolumeDependencyTests-1215626838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d2a2ce67-91f8-4659-a593-2623fb2779a3 tempest-VolumeDependencyTests-1215626838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d2a2ce67-91f8-4659-a593-2623fb2779a3 tempest-VolumeDependencyTests-1215626838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:56 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:17:56 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Flow 'volume_create_manager' (b52991f6-7f70-4c33-a009-4b4af23d389c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbafc8f5-c076-49a5-ab1d-f601aa09daa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbafc8f5-c076-49a5-ab1d-f601aa09daa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-275884584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=667b3807-df4f-4b5a-b117-c79e587c5cf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c20888cc0edb4d2f8f59a89088c3835c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:56Z,use_quota=True,user_id='9f5a5fc733b24894879b6cf1261b3cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5328ae4c-701e-4e43-95bf-e9987a0b395d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5328ae4c-701e-4e43-95bf-e9987a0b395d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6016a7a6-704f-49cb-9084-9219e73758ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6016a7a6-704f-49cb-9084-9219e73758ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '667b3807-df4f-4b5a-b117-c79e587c5cf8', 'volume_name': 'volume-667b3807-df4f-4b5a-b117-c79e587c5cf8', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:56 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62e36246-aad9-43e8-bc39-2d641bc7f2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62e36246-aad9-43e8-bc39-2d641bc7f2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af10209-2b63-4be5-8811-2b42c8661970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:56 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Volume 667b3807-df4f-4b5a-b117-c79e587c5cf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-667b3807-df4f-4b5a-b117-c79e587c5cf8', 'volume_size': 1} Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-275884584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=667b3807-df4f-4b5a-b117-c79e587c5cf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c20888cc0edb4d2f8f59a89088c3835c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:56Z,use_quota=True,user_id='9f5a5fc733b24894879b6cf1261b3cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Creating volume 667b3807-df4f-4b5a-b117-c79e587c5cf8 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:56 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-667b3807-df4f-4b5a-b117-c79e587c5cf8 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9ed70330-26eb-4f1e-b1c0-3ade691e7825 tempest-CinderUnicodeTest-1726310390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158.749273e9-98e3-45c9-9579-db169edbcc56" returned: 0 in 0.624s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9ed70330-26eb-4f1e-b1c0-3ade691e7825 tempest-CinderUnicodeTest-1726310390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158.749273e9-98e3-45c9-9579-db169edbcc56 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:56 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158.749273e9-98e3-45c9-9579-db169edbcc56 Sep 01 02:17:56 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:56 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-667b3807-df4f-4b5a-b117-c79e587c5cf8 1073741824 Sep 01 02:17:56 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:56 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d2a2ce67-91f8-4659-a593-2623fb2779a3 tempest-VolumeDependencyTests-1215626838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.386s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-d2a2ce67-91f8-4659-a593-2623fb2779a3 tempest-VolumeDependencyTests-1215626838 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:56 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-d2a2ce67-91f8-4659-a593-2623fb2779a3 tempest-VolumeDependencyTests-1215626838 None] Deleted volume successfully. Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-d2a2ce67-91f8-4659-a593-2623fb2779a3 tempest-VolumeDependencyTests-1215626838 None] Lock "cinder-c7e9202b-9ed3-4f48-a0c6-c452b13f30ff-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:56 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9ed70330-26eb-4f1e-b1c0-3ade691e7825 tempest-CinderUnicodeTest-1726310390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158.749273e9-98e3-45c9-9579-db169edbcc56" returned: 0 in 0.361s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:56 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9ed70330-26eb-4f1e-b1c0-3ade691e7825 tempest-CinderUnicodeTest-1726310390 None] Lock "cinder-quobyte-749273e9-98e3-45c9-9579-db169edbcc56" released by "_delete_snapshot" :: held 2.085s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9ed70330-26eb-4f1e-b1c0-3ade691e7825 tempest-CinderUnicodeTest-1726310390 None] Lock "cinder-quobyte-0830345c-7960-40ad-bc6b-3687caaab158" released by "delete_snapshot" :: held 2.121s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Flow 'volume_create_manager' (2e18b25d-0e19-49ac-9d89-03db959a3f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ba2cef-1136-4148-a275-a96de9e46330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ba2cef-1136-4148-a275-a96de9e46330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1308880216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=336d3ca3-edd2-4d18-86ff-5ecdce7e5825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c20888cc0edb4d2f8f59a89088c3835c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:57Z,use_quota=True,user_id='9f5a5fc733b24894879b6cf1261b3cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e4c826-4627-4cc0-ac12-9896155fe869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e4c826-4627-4cc0-ac12-9896155fe869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a6282c-006c-4ad8-8857-bbad1cbc27e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a6282c-006c-4ad8-8857-bbad1cbc27e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '336d3ca3-edd2-4d18-86ff-5ecdce7e5825', 'volume_name': 'volume-336d3ca3-edd2-4d18-86ff-5ecdce7e5825', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b99b6c11-2f90-4432-9bac-6bd3f5469929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b99b6c11-2f90-4432-9bac-6bd3f5469929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfea8edb-da4a-47bd-8d77-cf6bceaa7f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:57 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Volume 336d3ca3-edd2-4d18-86ff-5ecdce7e5825: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-336d3ca3-edd2-4d18-86ff-5ecdce7e5825', 'volume_size': 1} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-9ed70330-26eb-4f1e-b1c0-3ade691e7825 tempest-CinderUnicodeTest-1726310390 None] Created reservations ['5738d54f-58f1-472b-a9d3-30bf83b37714', 'f9461471-94db-41f6-8824-d88d938bab7b', '4319a81d-ec56-48bd-a23e-daddb38660ef', 'affb42e6-6c1e-4bda-bbc0-351ae77ec844'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:57 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-667b3807-df4f-4b5a-b117-c79e587c5cf8 1073741824" returned: 0 in 0.664s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-667b3807-df4f-4b5a-b117-c79e587c5cf8 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:57 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-667b3807-df4f-4b5a-b117-c79e587c5cf8 Sep 01 02:17:57 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:57 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-9ed70330-26eb-4f1e-b1c0-3ade691e7825 tempest-CinderUnicodeTest-1726310390 None] Delete snapshot completed successfully. Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Flow 'volume_create_manager' (6461812a-b7e3-4da3-baf3-bfce0c1aaf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (052ccf99-e3be-4233-84bc-f555fce9f9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9ed70330-26eb-4f1e-b1c0-3ade691e7825 tempest-CinderUnicodeTest-1726310390 None] Lock "cinder-749273e9-98e3-45c9-9579-db169edbcc56-delete_snapshot" released by "delete_snapshot" :: held 2.593s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (052ccf99-e3be-4233-84bc-f555fce9f9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-597349312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08f92b45-5306-497c-a1f3-7f10f8f0f603,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c20888cc0edb4d2f8f59a89088c3835c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:57Z,use_quota=True,user_id='9f5a5fc733b24894879b6cf1261b3cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea65a507-5200-4abe-be79-7619ad00e75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea65a507-5200-4abe-be79-7619ad00e75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec35170-9db6-4c17-8ec9-8643528cc9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec35170-9db6-4c17-8ec9-8643528cc9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08f92b45-5306-497c-a1f3-7f10f8f0f603', 'volume_name': 'volume-08f92b45-5306-497c-a1f3-7f10f8f0f603', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b7c7739-97b8-471f-b458-920984f47c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b7c7739-97b8-471f-b458-920984f47c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c49541ad-0cba-4666-8def-42f189d9e154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:57 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Volume 08f92b45-5306-497c-a1f3-7f10f8f0f603: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08f92b45-5306-497c-a1f3-7f10f8f0f603', 'volume_size': 1} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:57 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-667b3807-df4f-4b5a-b117-c79e587c5cf8" returned: 0 in 0.341s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.515s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1308880216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=336d3ca3-edd2-4d18-86ff-5ecdce7e5825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c20888cc0edb4d2f8f59a89088c3835c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:57Z,use_quota=True,user_id='9f5a5fc733b24894879b6cf1261b3cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Creating volume 336d3ca3-edd2-4d18-86ff-5ecdce7e5825 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:57 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-336d3ca3-edd2-4d18-86ff-5ecdce7e5825 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af10209-2b63-4be5-8811-2b42c8661970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-667b3807-df4f-4b5a-b117-c79e587c5cf8', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12fa4142-5a30-4e58-92ab-30d16fc959c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:57 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-336d3ca3-edd2-4d18-86ff-5ecdce7e5825 1073741824 Sep 01 02:17:57 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:57 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Volume volume-667b3807-df4f-4b5a-b117-c79e587c5cf8 (667b3807-df4f-4b5a-b117-c79e587c5cf8): created successfully Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12fa4142-5a30-4e58-92ab-30d16fc959c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Flow 'volume_create_manager' (b52991f6-7f70-4c33-a009-4b4af23d389c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:57 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-94f83053-9ff8-4a09-83cf-c7c829c9c403 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Created volume successfully. Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Flow 'volume_create_manager' (979136b7-fb5d-4e47-80ba-4ed6ae0cb3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94d27937-37b8-4af4-9885-3fbbaca04d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94d27937-37b8-4af4-9885-3fbbaca04d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-121163231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e79a6bcd-85be-43bc-977c-de1b1237b85a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c20888cc0edb4d2f8f59a89088c3835c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:58Z,use_quota=True,user_id='9f5a5fc733b24894879b6cf1261b3cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3d054df-c9e8-42d2-bff2-bf2f025a2226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3d054df-c9e8-42d2-bff2-bf2f025a2226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (237dfbdc-7c2d-4983-800d-9f5c557296e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (237dfbdc-7c2d-4983-800d-9f5c557296e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e79a6bcd-85be-43bc-977c-de1b1237b85a', 'volume_name': 'volume-e79a6bcd-85be-43bc-977c-de1b1237b85a', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (649c106c-430b-45e1-b5a2-33917ee5f501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (649c106c-430b-45e1-b5a2-33917ee5f501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0b1afe-a716-4f37-92e8-f0e3619a62d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:58 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Volume e79a6bcd-85be-43bc-977c-de1b1237b85a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e79a6bcd-85be-43bc-977c-de1b1237b85a', 'volume_size': 1} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:58 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-511211c3-6dd9-4e0a-96be-2f13159024f1 tempest-CinderUnicodeTest-1726310390 None] Acquiring lock "cinder-0830345c-7960-40ad-bc6b-3687caaab158-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-336d3ca3-edd2-4d18-86ff-5ecdce7e5825 1073741824" returned: 0 in 0.726s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-511211c3-6dd9-4e0a-96be-2f13159024f1 tempest-CinderUnicodeTest-1726310390 None] Lock "cinder-0830345c-7960-40ad-bc6b-3687caaab158-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] Flow 'volume_create_manager' (a567ea87-152f-40ab-aa0d-8e3b980eedc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e965d1e1-3b0b-4072-a77e-628e14a428ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-336d3ca3-edd2-4d18-86ff-5ecdce7e5825 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e965d1e1-3b0b-4072-a77e-628e14a428ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1467238379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7a7930-b875-4291-9245-b82da2cae8e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2693a692ba24fb280d3a8a3c985cfd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:58Z,use_quota=True,user_id='3d9220a9bc1248d389d956dcda51a982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b32a2be-4d49-43a4-9625-127fe5b84208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b32a2be-4d49-43a4-9625-127fe5b84208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd798e2-e627-487a-b4f5-3680ae2a435e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:58 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-336d3ca3-edd2-4d18-86ff-5ecdce7e5825 Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd798e2-e627-487a-b4f5-3680ae2a435e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db7a7930-b875-4291-9245-b82da2cae8e5', 'volume_name': 'volume-db7a7930-b875-4291-9245-b82da2cae8e5', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:58 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed21830-b2b6-48f6-a6e1-5d8518a61273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed21830-b2b6-48f6-a6e1-5d8518a61273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f92f2c7-ca6b-409d-9061-31e2daa19f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:58 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] Volume db7a7930-b875-4291-9245-b82da2cae8e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db7a7930-b875-4291-9245-b82da2cae8e5', 'volume_size': 1} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-511211c3-6dd9-4e0a-96be-2f13159024f1 tempest-CinderUnicodeTest-1726310390 None] Acquiring lock "cinder-quobyte-0830345c-7960-40ad-bc6b-3687caaab158" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-511211c3-6dd9-4e0a-96be-2f13159024f1 tempest-CinderUnicodeTest-1726310390 None] Lock "cinder-quobyte-0830345c-7960-40ad-bc6b-3687caaab158" acquired by "delete_volume" :: waited 0.021s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Flow 'volume_create_manager' (a27fa6c8-c5ca-4ca6-b954-16768e16d1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0a2de22-9858-4cc5-87e5-1528ea648be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca7b3f0-3428-4a31-bd0a-dc63555dd18e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-511211c3-6dd9-4e0a-96be-2f13159024f1 tempest-CinderUnicodeTest-1726310390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0a2de22-9858-4cc5-87e5-1528ea648be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-977443702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77901cbb-e9c0-4730-8476-8185199d8597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c20888cc0edb4d2f8f59a89088c3835c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:59Z,use_quota=True,user_id='9f5a5fc733b24894879b6cf1261b3cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff427bab-f876-4b13-b575-8c0d7aada4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff427bab-f876-4b13-b575-8c0d7aada4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f676516-6fc1-42e0-86cf-8b0f7e37ba3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f676516-6fc1-42e0-86cf-8b0f7e37ba3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77901cbb-e9c0-4730-8476-8185199d8597', 'volume_name': 'volume-77901cbb-e9c0-4730-8476-8185199d8597', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ffb1f5e-02b5-4f94-99fb-25f5352f3282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ffb1f5e-02b5-4f94-99fb-25f5352f3282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (657b3175-6f59-4095-9b42-789de6bb08a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:58 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Volume 77901cbb-e9c0-4730-8476-8185199d8597: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77901cbb-e9c0-4730-8476-8185199d8597', 'volume_size': 1} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:58 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-336d3ca3-edd2-4d18-86ff-5ecdce7e5825" returned: 0 in 0.370s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.332s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-597349312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08f92b45-5306-497c-a1f3-7f10f8f0f603,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c20888cc0edb4d2f8f59a89088c3835c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:57Z,use_quota=True,user_id='9f5a5fc733b24894879b6cf1261b3cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Creating volume 08f92b45-5306-497c-a1f3-7f10f8f0f603 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:58 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158 Sep 01 02:17:58 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:58 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f92b45-5306-497c-a1f3-7f10f8f0f603 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfea8edb-da4a-47bd-8d77-cf6bceaa7f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-336d3ca3-edd2-4d18-86ff-5ecdce7e5825', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (778bae10-2a3f-4a27-b4a8-47f58134242e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:58 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f92b45-5306-497c-a1f3-7f10f8f0f603 1073741824 Sep 01 02:17:58 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:58 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Volume volume-336d3ca3-edd2-4d18-86ff-5ecdce7e5825 (336d3ca3-edd2-4d18-86ff-5ecdce7e5825): created successfully Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (778bae10-2a3f-4a27-b4a8-47f58134242e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Flow 'volume_create_manager' (2e18b25d-0e19-49ac-9d89-03db959a3f67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:58 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-d9ee6d05-cca7-4edc-bb75-be9c38c35e62 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Created volume successfully. Sep 01 02:17:59 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-511211c3-6dd9-4e0a-96be-2f13159024f1 tempest-CinderUnicodeTest-1726310390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158" returned: 0 in 0.491s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-511211c3-6dd9-4e0a-96be-2f13159024f1 tempest-CinderUnicodeTest-1726310390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:59 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158 Sep 01 02:17:59 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:59 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-511211c3-6dd9-4e0a-96be-2f13159024f1 tempest-CinderUnicodeTest-1726310390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0830345c-7960-40ad-bc6b-3687caaab158" returned: 0 in 0.295s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:59 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-511211c3-6dd9-4e0a-96be-2f13159024f1 tempest-CinderUnicodeTest-1726310390 None] Lock "cinder-quobyte-0830345c-7960-40ad-bc6b-3687caaab158" released by "delete_volume" :: held 0.897s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:59 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-511211c3-6dd9-4e0a-96be-2f13159024f1 tempest-CinderUnicodeTest-1726310390 None] Created reservations ['8770d55c-d547-4aa8-a8af-6e4dd795a347', 'c266ace0-34d8-4ecd-8891-a74beac82a05', '512a3443-8998-4f98-bb47-494109ec8277', '93cf79c0-2395-4968-b2f9-0d427c467b63'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:59 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f92b45-5306-497c-a1f3-7f10f8f0f603 1073741824" returned: 0 in 0.750s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-511211c3-6dd9-4e0a-96be-2f13159024f1 tempest-CinderUnicodeTest-1726310390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-511211c3-6dd9-4e0a-96be-2f13159024f1 tempest-CinderUnicodeTest-1726310390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:59 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-511211c3-6dd9-4e0a-96be-2f13159024f1 tempest-CinderUnicodeTest-1726310390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:59 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-511211c3-6dd9-4e0a-96be-2f13159024f1 tempest-CinderUnicodeTest-1726310390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-511211c3-6dd9-4e0a-96be-2f13159024f1 tempest-CinderUnicodeTest-1726310390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-511211c3-6dd9-4e0a-96be-2f13159024f1 tempest-CinderUnicodeTest-1726310390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f92b45-5306-497c-a1f3-7f10f8f0f603 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:59 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:17:59 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:59 devstack sudo[105373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f92b45-5306-497c-a1f3-7f10f8f0f603 Sep 01 02:17:59 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:59 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:59 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-511211c3-6dd9-4e0a-96be-2f13159024f1 tempest-CinderUnicodeTest-1726310390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.299s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:59 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-511211c3-6dd9-4e0a-96be-2f13159024f1 tempest-CinderUnicodeTest-1726310390 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f92b45-5306-497c-a1f3-7f10f8f0f603" returned: 0 in 0.291s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:59 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.605s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:59 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-121163231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e79a6bcd-85be-43bc-977c-de1b1237b85a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c20888cc0edb4d2f8f59a89088c3835c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:58Z,use_quota=True,user_id='9f5a5fc733b24894879b6cf1261b3cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:59 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Creating volume e79a6bcd-85be-43bc-977c-de1b1237b85a {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:59 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:59 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:59 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:59 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:17:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e79a6bcd-85be-43bc-977c-de1b1237b85a 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:59 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-511211c3-6dd9-4e0a-96be-2f13159024f1 tempest-CinderUnicodeTest-1726310390 None] Deleted volume successfully. Sep 01 02:18:00 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e79a6bcd-85be-43bc-977c-de1b1237b85a 1073741824 Sep 01 02:18:00 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c49541ad-0cba-4666-8def-42f189d9e154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08f92b45-5306-497c-a1f3-7f10f8f0f603', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc927e0-aaab-45a3-9bde-7925c2e5d698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:00 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Volume volume-08f92b45-5306-497c-a1f3-7f10f8f0f603 (08f92b45-5306-497c-a1f3-7f10f8f0f603): created successfully Sep 01 02:18:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc927e0-aaab-45a3-9bde-7925c2e5d698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Flow 'volume_create_manager' (6461812a-b7e3-4da3-baf3-bfce0c1aaf6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:00 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-511211c3-6dd9-4e0a-96be-2f13159024f1 tempest-CinderUnicodeTest-1726310390 None] Lock "cinder-0830345c-7960-40ad-bc6b-3687caaab158-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:00 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-aaaa400f-f76f-4a82-85d3-ec462cd9ad17 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Created volume successfully. Sep 01 02:18:00 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e79a6bcd-85be-43bc-977c-de1b1237b85a 1073741824" returned: 0 in 0.481s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e79a6bcd-85be-43bc-977c-de1b1237b85a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:00 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e79a6bcd-85be-43bc-977c-de1b1237b85a Sep 01 02:18:00 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:00 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ea8541d8-7b0f-42aa-81c7-47a64bed8d2d tempest-CinderUnicodeTest-1726310390 None] Acquiring lock "cinder-c299f188-f7c1-4c89-bdfa-e93f964adb5f-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:00 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ea8541d8-7b0f-42aa-81c7-47a64bed8d2d tempest-CinderUnicodeTest-1726310390 None] Lock "cinder-c299f188-f7c1-4c89-bdfa-e93f964adb5f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:00 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ea8541d8-7b0f-42aa-81c7-47a64bed8d2d tempest-CinderUnicodeTest-1726310390 None] Acquiring lock "cinder-quobyte-c299f188-f7c1-4c89-bdfa-e93f964adb5f" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:00 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ea8541d8-7b0f-42aa-81c7-47a64bed8d2d tempest-CinderUnicodeTest-1726310390 None] Lock "cinder-quobyte-c299f188-f7c1-4c89-bdfa-e93f964adb5f" acquired by "delete_volume" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:00 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[914e6e8a-e97e-407a-9b81-afdf33b868ef]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ea8541d8-7b0f-42aa-81c7-47a64bed8d2d tempest-CinderUnicodeTest-1726310390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c299f188-f7c1-4c89-bdfa-e93f964adb5f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:00 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c299f188-f7c1-4c89-bdfa-e93f964adb5f Sep 01 02:18:00 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:00 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e79a6bcd-85be-43bc-977c-de1b1237b85a" returned: 0 in 0.355s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:00 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.328s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:00 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1467238379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7a7930-b875-4291-9245-b82da2cae8e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2693a692ba24fb280d3a8a3c985cfd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:58Z,use_quota=True,user_id='3d9220a9bc1248d389d956dcda51a982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:00 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] Creating volume db7a7930-b875-4291-9245-b82da2cae8e5 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:00 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:00 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:00 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:00 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:18:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0b1afe-a716-4f37-92e8-f0e3619a62d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e79a6bcd-85be-43bc-977c-de1b1237b85a', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:00 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5 1073741824 Sep 01 02:18:00 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d541e5f-7b09-40b9-b0d2-5143c0d0bfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:00 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Volume volume-e79a6bcd-85be-43bc-977c-de1b1237b85a (e79a6bcd-85be-43bc-977c-de1b1237b85a): created successfully Sep 01 02:18:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d541e5f-7b09-40b9-b0d2-5143c0d0bfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Flow 'volume_create_manager' (979136b7-fb5d-4e47-80ba-4ed6ae0cb3fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:00 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-fdd6afaa-748d-4c4a-8440-2cc9e24bd4a2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Created volume successfully. Sep 01 02:18:01 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ea8541d8-7b0f-42aa-81c7-47a64bed8d2d tempest-CinderUnicodeTest-1726310390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c299f188-f7c1-4c89-bdfa-e93f964adb5f" returned: 0 in 0.464s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ea8541d8-7b0f-42aa-81c7-47a64bed8d2d tempest-CinderUnicodeTest-1726310390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c299f188-f7c1-4c89-bdfa-e93f964adb5f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:01 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c299f188-f7c1-4c89-bdfa-e93f964adb5f Sep 01 02:18:01 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:01 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5 1073741824" returned: 0 in 0.544s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:01 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ea8541d8-7b0f-42aa-81c7-47a64bed8d2d tempest-CinderUnicodeTest-1726310390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c299f188-f7c1-4c89-bdfa-e93f964adb5f" returned: 0 in 0.288s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:01 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ea8541d8-7b0f-42aa-81c7-47a64bed8d2d tempest-CinderUnicodeTest-1726310390 None] Lock "cinder-quobyte-c299f188-f7c1-4c89-bdfa-e93f964adb5f" released by "delete_volume" :: held 0.801s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:01 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5 Sep 01 02:18:01 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:01 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-ea8541d8-7b0f-42aa-81c7-47a64bed8d2d tempest-CinderUnicodeTest-1726310390 None] Created reservations ['5789ae0b-2e71-4f2f-b956-55277d902c89', 'a74ccdfb-8827-462c-9b70-a508f7787284', '0d971daf-ccac-4862-9771-d827e27df839', 'b3ae033c-de3a-4b65-8a16-df351547aaab'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ea8541d8-7b0f-42aa-81c7-47a64bed8d2d tempest-CinderUnicodeTest-1726310390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ea8541d8-7b0f-42aa-81c7-47a64bed8d2d tempest-CinderUnicodeTest-1726310390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:01 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-ea8541d8-7b0f-42aa-81c7-47a64bed8d2d tempest-CinderUnicodeTest-1726310390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:01 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-ea8541d8-7b0f-42aa-81c7-47a64bed8d2d tempest-CinderUnicodeTest-1726310390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-ea8541d8-7b0f-42aa-81c7-47a64bed8d2d tempest-CinderUnicodeTest-1726310390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ea8541d8-7b0f-42aa-81c7-47a64bed8d2d tempest-CinderUnicodeTest-1726310390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:01 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:18:01 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:01 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5" returned: 0 in 0.421s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:01 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.167s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:01 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-977443702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77901cbb-e9c0-4730-8476-8185199d8597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c20888cc0edb4d2f8f59a89088c3835c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:59Z,use_quota=True,user_id='9f5a5fc733b24894879b6cf1261b3cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:01 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Creating volume 77901cbb-e9c0-4730-8476-8185199d8597 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:01 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:01 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:01 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:01 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:18:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-77901cbb-e9c0-4730-8476-8185199d8597 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f92f2c7-ca6b-409d-9061-31e2daa19f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db7a7930-b875-4291-9245-b82da2cae8e5', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:02 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-77901cbb-e9c0-4730-8476-8185199d8597 1073741824 Sep 01 02:18:02 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3959529e-d13c-4d59-a204-ec8b159dbf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:02 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] Volume volume-db7a7930-b875-4291-9245-b82da2cae8e5 (db7a7930-b875-4291-9245-b82da2cae8e5): created successfully Sep 01 02:18:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3959529e-d13c-4d59-a204-ec8b159dbf00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] Flow 'volume_create_manager' (a567ea87-152f-40ab-aa0d-8e3b980eedc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:02 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-03346f3d-e1f7-4c5a-9de6-d78200a22e86 tempest-SnapshotDependencyTests-105651827 None] Created volume successfully. Sep 01 02:18:02 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-ea8541d8-7b0f-42aa-81c7-47a64bed8d2d tempest-CinderUnicodeTest-1726310390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.422s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:02 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-ea8541d8-7b0f-42aa-81c7-47a64bed8d2d tempest-CinderUnicodeTest-1726310390 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:02 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-ea8541d8-7b0f-42aa-81c7-47a64bed8d2d tempest-CinderUnicodeTest-1726310390 None] Deleted volume successfully. Sep 01 02:18:02 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-ea8541d8-7b0f-42aa-81c7-47a64bed8d2d tempest-CinderUnicodeTest-1726310390 None] Lock "cinder-c299f188-f7c1-4c89-bdfa-e93f964adb5f-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:02 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-77901cbb-e9c0-4730-8476-8185199d8597 1073741824" returned: 0 in 0.652s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-77901cbb-e9c0-4730-8476-8185199d8597 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:02 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-77901cbb-e9c0-4730-8476-8185199d8597 Sep 01 02:18:02 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:02 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-77901cbb-e9c0-4730-8476-8185199d8597" returned: 0 in 0.327s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (657b3175-6f59-4095-9b42-789de6bb08a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77901cbb-e9c0-4730-8476-8185199d8597', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5c713f-c539-4de7-b8f4-127d9e950e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:03 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Volume volume-77901cbb-e9c0-4730-8476-8185199d8597 (77901cbb-e9c0-4730-8476-8185199d8597): created successfully Sep 01 02:18:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5c713f-c539-4de7-b8f4-127d9e950e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:03 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Flow 'volume_create_manager' (a27fa6c8-c5ca-4ca6-b954-16768e16d1cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:03 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-b5b3bcef-7a44-42b2-b4a5-1bb3f4abdd98 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Created volume successfully. Sep 01 02:18:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-baa52aa8-0923-4824-b607-f97ca2220916 tempest-SnapshotDependencyTests-105651827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-baa52aa8-0923-4824-b607-f97ca2220916 tempest-SnapshotDependencyTests-105651827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:03 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-baa52aa8-0923-4824-b607-f97ca2220916 tempest-SnapshotDependencyTests-105651827 None] Creating offline snapshot bd53e084-64df-4d7c-8df6-16e858176a0f of volume db7a7930-b875-4291-9245-b82da2cae8e5 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:18:03 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11ecf49-aa54-48bd-acfc-f411797b944a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-baa52aa8-0923-4824-b607-f97ca2220916 tempest-SnapshotDependencyTests-105651827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:03 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5 Sep 01 02:18:03 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:04 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-baa52aa8-0923-4824-b607-f97ca2220916 tempest-SnapshotDependencyTests-105651827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5" returned: 0 in 0.440s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-baa52aa8-0923-4824-b607-f97ca2220916 tempest-SnapshotDependencyTests-105651827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5.bd53e084-64df-4d7c-8df6-16e858176a0f 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:04 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-51b5e126-451b-49b1-b811-87bdf0e418ca tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Acquiring lock "cinder-77901cbb-e9c0-4730-8476-8185199d8597-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:04 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5.bd53e084-64df-4d7c-8df6-16e858176a0f 1G Sep 01 02:18:04 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:04 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-51b5e126-451b-49b1-b811-87bdf0e418ca tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "cinder-77901cbb-e9c0-4730-8476-8185199d8597-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:04 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-51b5e126-451b-49b1-b811-87bdf0e418ca tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Acquiring lock "cinder-quobyte-77901cbb-e9c0-4730-8476-8185199d8597" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:04 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-51b5e126-451b-49b1-b811-87bdf0e418ca tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "cinder-quobyte-77901cbb-e9c0-4730-8476-8185199d8597" acquired by "delete_volume" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:04 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb3ffc3-a8f5-4e43-a600-1ea40daadc69]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51b5e126-451b-49b1-b811-87bdf0e418ca tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-77901cbb-e9c0-4730-8476-8185199d8597 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:04 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-77901cbb-e9c0-4730-8476-8185199d8597 Sep 01 02:18:04 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:04 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-baa52aa8-0923-4824-b607-f97ca2220916 tempest-SnapshotDependencyTests-105651827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5.bd53e084-64df-4d7c-8df6-16e858176a0f 1G" returned: 0 in 0.567s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-baa52aa8-0923-4824-b607-f97ca2220916 tempest-SnapshotDependencyTests-105651827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db7a7930-b875-4291-9245-b82da2cae8e5 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5.bd53e084-64df-4d7c-8df6-16e858176a0f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:04 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db7a7930-b875-4291-9245-b82da2cae8e5 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5.bd53e084-64df-4d7c-8df6-16e858176a0f Sep 01 02:18:04 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:04 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51b5e126-451b-49b1-b811-87bdf0e418ca tempest-CreateVolumesFromSourceVolumeTest-915552932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-77901cbb-e9c0-4730-8476-8185199d8597" returned: 0 in 0.456s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51b5e126-451b-49b1-b811-87bdf0e418ca tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-77901cbb-e9c0-4730-8476-8185199d8597 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:04 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-77901cbb-e9c0-4730-8476-8185199d8597 Sep 01 02:18:04 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:04 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:04 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-baa52aa8-0923-4824-b607-f97ca2220916 tempest-SnapshotDependencyTests-105651827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db7a7930-b875-4291-9245-b82da2cae8e5 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5.bd53e084-64df-4d7c-8df6-16e858176a0f" returned: 0 in 0.333s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:05 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-baa52aa8-0923-4824-b607-f97ca2220916 tempest-SnapshotDependencyTests-105651827 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5.bd53e084-64df-4d7c-8df6-16e858176a0f is being set with open permissions: ugo+rw Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-baa52aa8-0923-4824-b607-f97ca2220916 tempest-SnapshotDependencyTests-105651827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5.bd53e084-64df-4d7c-8df6-16e858176a0f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51b5e126-451b-49b1-b811-87bdf0e418ca tempest-CreateVolumesFromSourceVolumeTest-915552932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-77901cbb-e9c0-4730-8476-8185199d8597" returned: 0 in 0.304s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:05 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5.bd53e084-64df-4d7c-8df6-16e858176a0f Sep 01 02:18:05 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-51b5e126-451b-49b1-b811-87bdf0e418ca tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "cinder-quobyte-77901cbb-e9c0-4730-8476-8185199d8597" released by "delete_volume" :: held 0.818s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-51b5e126-451b-49b1-b811-87bdf0e418ca tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Created reservations ['8f944a2f-1b8c-4652-848c-10d9d72290a0', '1eace42b-a926-4e33-b0ba-f8cc7e1dc3c7', 'b680918a-ed95-4acf-b7f9-755a816f9dc1', 'c6eae017-4a43-405c-8cbd-6d5951572b92'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-51b5e126-451b-49b1-b811-87bdf0e418ca tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-51b5e126-451b-49b1-b811-87bdf0e418ca tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-51b5e126-451b-49b1-b811-87bdf0e418ca tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-51b5e126-451b-49b1-b811-87bdf0e418ca tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-51b5e126-451b-49b1-b811-87bdf0e418ca tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51b5e126-451b-49b1-b811-87bdf0e418ca tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:05 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:18:05 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-51cc3011-e62d-4335-96dc-f9897fe9efa8 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Acquiring lock "cinder-e79a6bcd-85be-43bc-977c-de1b1237b85a-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-51cc3011-e62d-4335-96dc-f9897fe9efa8 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "cinder-e79a6bcd-85be-43bc-977c-de1b1237b85a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:05 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-baa52aa8-0923-4824-b607-f97ca2220916 tempest-SnapshotDependencyTests-105651827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5.bd53e084-64df-4d7c-8df6-16e858176a0f" returned: 0 in 0.406s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-51cc3011-e62d-4335-96dc-f9897fe9efa8 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Acquiring lock "cinder-quobyte-e79a6bcd-85be-43bc-977c-de1b1237b85a" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-baa52aa8-0923-4824-b607-f97ca2220916 tempest-SnapshotDependencyTests-105651827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:05 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5.info Sep 01 02:18:05 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-51cc3011-e62d-4335-96dc-f9897fe9efa8 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "cinder-quobyte-e79a6bcd-85be-43bc-977c-de1b1237b85a" acquired by "delete_volume" :: waited 0.047s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b1df1f-9673-4350-80c2-0d166074b3ba]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51cc3011-e62d-4335-96dc-f9897fe9efa8 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e79a6bcd-85be-43bc-977c-de1b1237b85a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:05 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51b5e126-451b-49b1-b811-87bdf0e418ca tempest-CreateVolumesFromSourceVolumeTest-915552932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.351s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-51b5e126-451b-49b1-b811-87bdf0e418ca tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:05 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-51b5e126-451b-49b1-b811-87bdf0e418ca tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Deleted volume successfully. Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:05 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e79a6bcd-85be-43bc-977c-de1b1237b85a Sep 01 02:18:05 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Flow 'volume_create_manager' (84eca7a9-7308-4373-ad35-e583a5c6bcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b8009c-070a-448c-b06a-4b9a78e50d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-51b5e126-451b-49b1-b811-87bdf0e418ca tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "cinder-77901cbb-e9c0-4730-8476-8185199d8597-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b8009c-070a-448c-b06a-4b9a78e50d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa28539b-b2d3-4e32-a4c6-99ef86de0a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='851bd101242f4b3cb1530c2ef0c36dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:06Z,use_quota=True,user_id='eb6f1b61fc894f018642fe9f1496502a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d4c669b-8462-42d8-bfd2-8055b8037def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d4c669b-8462-42d8-bfd2-8055b8037def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (745426c4-fbe4-485a-84c4-010c32f443e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG cinder.image.glance [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Creating Keystone auth plugin from conf {{(pid=87128) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:18:05 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-baa52aa8-0923-4824-b607-f97ca2220916 tempest-SnapshotDependencyTests-105651827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5.info" returned: 0 in 0.361s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:05 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-baa52aa8-0923-4824-b607-f97ca2220916 tempest-SnapshotDependencyTests-105651827 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5.info is being set with open permissions: ugo+rw Sep 01 02:18:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-baa52aa8-0923-4824-b607-f97ca2220916 tempest-SnapshotDependencyTests-105651827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:05 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5.info Sep 01 02:18:05 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-0c02ffba-3e97-4262-97c7-b9c58a5fb7f2 tempest-ProjectAdminTests-263704670 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.0156593322754, 'free_capacity_gb': 1774.0156593322754, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87128) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 02:18:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51cc3011-e62d-4335-96dc-f9897fe9efa8 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e79a6bcd-85be-43bc-977c-de1b1237b85a" returned: 0 in 0.479s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:06 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51cc3011-e62d-4335-96dc-f9897fe9efa8 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e79a6bcd-85be-43bc-977c-de1b1237b85a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:06 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e79a6bcd-85be-43bc-977c-de1b1237b85a Sep 01 02:18:06 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:06 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-baa52aa8-0923-4824-b607-f97ca2220916 tempest-SnapshotDependencyTests-105651827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5.info" returned: 0 in 0.354s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-baa52aa8-0923-4824-b607-f97ca2220916 tempest-SnapshotDependencyTests-105651827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.599s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (745426c4-fbe4-485a-84c4-010c32f443e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fa28539b-b2d3-4e32-a4c6-99ef86de0a0a', 'volume_name': 'volume-fa28539b-b2d3-4e32-a4c6-99ef86de0a0a', 'volume_size': 1, 'image_id': 'ec36edad-9f57-4d49-845b-390b3fc2271f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ec36edad-9f57-4d49-845b-390b3fc2271f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0d460e83f9133ea11f8678412e956542', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '851bd101242f4b3cb1530c2ef0c36dd2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3cea509b3e9bcfef041075d405a62fd20d49dbe7c2c9021954f31d773c08c6d8ab864a5bea91f61fda8be1d449b83c8414b62e7051b8a9bbbceda51f3eae1e65', 'id': 'ec36edad-9f57-4d49-845b-390b3fc2271f', 'created_at': datetime.datetime(2026, 9, 1, 0, 18, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 18, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ec36edad-9f57-4d49-845b-390b3fc2271f/file', 'properties': {}}, 'image_service': }' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7992252e-f0c9-4022-951f-73bc3e2d7704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7992252e-f0c9-4022-951f-73bc3e2d7704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3452750-2769-413f-928a-6ca04e1a208b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:06 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Volume fa28539b-b2d3-4e32-a4c6-99ef86de0a0a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fa28539b-b2d3-4e32-a4c6-99ef86de0a0a', 'volume_size': 1, 'image_id': 'ec36edad-9f57-4d49-845b-390b3fc2271f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ec36edad-9f57-4d49-845b-390b3fc2271f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0d460e83f9133ea11f8678412e956542', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '851bd101242f4b3cb1530c2ef0c36dd2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3cea509b3e9bcfef041075d405a62fd20d49dbe7c2c9021954f31d773c08c6d8ab864a5bea91f61fda8be1d449b83c8414b62e7051b8a9bbbceda51f3eae1e65', 'id': 'ec36edad-9f57-4d49-845b-390b3fc2271f', 'created_at': datetime.datetime(2026, 9, 1, 0, 18, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 18, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ec36edad-9f57-4d49-845b-390b3fc2271f/file', 'properties': {}}, 'image_service': } Sep 01 02:18:06 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Trying to clone fa28539b-b2d3-4e32-a4c6-99ef86de0a0a from image ec36edad-9f57-4d49-845b-390b3fc2271f at location (None, [{'url': 'file:///opt/stack/data/glance/images/ec36edad-9f57-4d49-845b-390b3fc2271f', 'metadata': {}}]). {{(pid=87128) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:18:06 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-baa52aa8-0923-4824-b607-f97ca2220916 tempest-SnapshotDependencyTests-105651827 None] Create snapshot completed successfully Sep 01 02:18:06 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51cc3011-e62d-4335-96dc-f9897fe9efa8 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e79a6bcd-85be-43bc-977c-de1b1237b85a" returned: 0 in 0.360s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:06 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-51cc3011-e62d-4335-96dc-f9897fe9efa8 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "cinder-quobyte-e79a6bcd-85be-43bc-977c-de1b1237b85a" released by "delete_volume" :: held 0.915s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:06 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ec36edad-9f57-4d49-845b-390b3fc2271f_6uxa6mecdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87128) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:18:06 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Image download 0.00 MB at 0.00 MB/s Sep 01 02:18:06 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-51cc3011-e62d-4335-96dc-f9897fe9efa8 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Created reservations ['c3788da6-101a-4c82-a883-4b4178e0ace0', 'd2d6ecb8-b7ee-4fba-a1ac-5bd42a41ad3d', '3c29473c-6106-44e0-96f6-04f67b113b88', '55a76ff4-0f02-4574-9b7d-17c4580a8e46'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:06 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf49246-aaf2-4eb6-a755-980919e8ff1e]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec36edad-9f57-4d49-845b-390b3fc2271f_6uxa6mecdevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-51cc3011-e62d-4335-96dc-f9897fe9efa8 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-51cc3011-e62d-4335-96dc-f9897fe9efa8 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:06 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-51cc3011-e62d-4335-96dc-f9897fe9efa8 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:06 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-51cc3011-e62d-4335-96dc-f9897fe9efa8 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-51cc3011-e62d-4335-96dc-f9897fe9efa8 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51cc3011-e62d-4335-96dc-f9897fe9efa8 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:06 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:18:06 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:06 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec36edad-9f57-4d49-845b-390b3fc2271f_6uxa6mecdevstack@QuobyteHD Sep 01 02:18:06 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:06 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec36edad-9f57-4d49-845b-390b3fc2271f_6uxa6mecdevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec36edad-9f57-4d49-845b-390b3fc2271f_6uxa6mecdevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:07 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-51cc3011-e62d-4335-96dc-f9897fe9efa8 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.359s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-51cc3011-e62d-4335-96dc-f9897fe9efa8 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:07 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-51cc3011-e62d-4335-96dc-f9897fe9efa8 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Deleted volume successfully. Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-51cc3011-e62d-4335-96dc-f9897fe9efa8 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "cinder-e79a6bcd-85be-43bc-977c-de1b1237b85a-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:07 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec36edad-9f57-4d49-845b-390b3fc2271f_6uxa6mecdevstack@QuobyteHD Sep 01 02:18:07 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:07 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec36edad-9f57-4d49-845b-390b3fc2271f_6uxa6mecdevstack@QuobyteHD" returned: 1 in 0.413s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec36edad-9f57-4d49-845b-390b3fc2271f_6uxa6mecdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Temporary image ec36edad-9f57-4d49-845b-390b3fc2271f is fetched for user eb6f1b61fc894f018642fe9f1496502a. {{(pid=87128) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[06289295-79b1-41a0-9a75-d9a1909a3f1b]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec36edad-9f57-4d49-845b-390b3fc2271f_6uxa6mecdevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:07 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec36edad-9f57-4d49-845b-390b3fc2271f_6uxa6mecdevstack@QuobyteHD Sep 01 02:18:07 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Flow 'volume_create_manager' (605e9a02-ed3d-43ea-9d6a-b2c31b052d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (988d4c40-955b-4cd9-ba9a-383633cdd804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (988d4c40-955b-4cd9-ba9a-383633cdd804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=281f89e7-915f-4103-815e-428b7a187116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2693a692ba24fb280d3a8a3c985cfd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bd53e084-64df-4d7c-8df6-16e858176a0f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:08Z,use_quota=True,user_id='3d9220a9bc1248d389d956dcda51a982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (991ea531-83b3-4f13-9100-c0678e3772dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (991ea531-83b3-4f13-9100-c0678e3772dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb2cff91-da49-41f4-bed5-26bd203dd5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb2cff91-da49-41f4-bed5-26bd203dd5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '281f89e7-915f-4103-815e-428b7a187116', 'volume_name': 'volume-281f89e7-915f-4103-815e-428b7a187116', 'volume_size': 1, 'snapshot_id': 'bd53e084-64df-4d7c-8df6-16e858176a0f'}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47521f2f-5991-4e30-bd47-b5e1e4ee0250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47521f2f-5991-4e30-bd47-b5e1e4ee0250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb75b26d-4357-486d-b1a3-7a6d897289c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:07 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Volume 281f89e7-915f-4103-815e-428b7a187116: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-281f89e7-915f-4103-815e-428b7a187116', 'volume_size': 1, 'snapshot_id': 'bd53e084-64df-4d7c-8df6-16e858176a0f'} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5cd71365-40fd-4a4f-9d16-c8f00fb5886c tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Acquiring lock "cinder-08f92b45-5306-497c-a1f3-7f10f8f0f603-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Acquiring lock "cinder-quobyte-bd53e084-64df-4d7c-8df6-16e858176a0f-281f89e7-915f-4103-815e-428b7a187116" by "_create_volume_from_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Lock "cinder-quobyte-bd53e084-64df-4d7c-8df6-16e858176a0f-281f89e7-915f-4103-815e-428b7a187116" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Creating volume 281f89e7-915f-4103-815e-428b7a187116 from snapshot bd53e084-64df-4d7c-8df6-16e858176a0f {{(pid=87128) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Acquiring lock "cinder-quobyte-281f89e7-915f-4103-815e-428b7a187116" by "_copy_volume_from_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5cd71365-40fd-4a4f-9d16-c8f00fb5886c tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "cinder-08f92b45-5306-497c-a1f3-7f10f8f0f603-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Lock "cinder-quobyte-281f89e7-915f-4103-815e-428b7a187116" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] snapshot: bd53e084-64df-4d7c-8df6-16e858176a0f, volume: 281f89e7-915f-4103-815e-428b7a187116, {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5cd71365-40fd-4a4f-9d16-c8f00fb5886c tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Acquiring lock "cinder-quobyte-08f92b45-5306-497c-a1f3-7f10f8f0f603" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8a1741-c8ce-47a0-bc54-5177597f2069]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5.bd53e084-64df-4d7c-8df6-16e858176a0f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5cd71365-40fd-4a4f-9d16-c8f00fb5886c tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "cinder-quobyte-08f92b45-5306-497c-a1f3-7f10f8f0f603" acquired by "delete_volume" :: waited 0.028s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:07 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec36edad-9f57-4d49-845b-390b3fc2271f_6uxa6mecdevstack@QuobyteHD" returned: 0 in 0.448s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec36edad-9f57-4d49-845b-390b3fc2271f_6uxa6mecdevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc922e9-57a4-4b57-bb45-c8c684f47484]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5cd71365-40fd-4a4f-9d16-c8f00fb5886c tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f92b45-5306-497c-a1f3-7f10f8f0f603 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:07 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5.bd53e084-64df-4d7c-8df6-16e858176a0f Sep 01 02:18:07 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:08 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec36edad-9f57-4d49-845b-390b3fc2271f_6uxa6mecdevstack@QuobyteHD Sep 01 02:18:08 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:08 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f92b45-5306-497c-a1f3-7f10f8f0f603 Sep 01 02:18:08 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:08 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec36edad-9f57-4d49-845b-390b3fc2271f_6uxa6mecdevstack@QuobyteHD" returned: 1 in 0.353s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec36edad-9f57-4d49-845b-390b3fc2271f_6uxa6mecdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:18:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:08 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5.bd53e084-64df-4d7c-8df6-16e858176a0f" returned: 0 in 0.438s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db7a7930-b875-4291-9245-b82da2cae8e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:18:08 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e83ecc3-0a5e-4890-9ef4-ef61a2db9a4c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:08 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5cd71365-40fd-4a4f-9d16-c8f00fb5886c tempest-CreateVolumesFromSourceVolumeTest-915552932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f92b45-5306-497c-a1f3-7f10f8f0f603" returned: 0 in 0.457s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5cd71365-40fd-4a4f-9d16-c8f00fb5886c tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f92b45-5306-497c-a1f3-7f10f8f0f603 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:08 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f92b45-5306-497c-a1f3-7f10f8f0f603 Sep 01 02:18:08 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:08 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5 Sep 01 02:18:08 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:08 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5cd71365-40fd-4a4f-9d16-c8f00fb5886c tempest-CreateVolumesFromSourceVolumeTest-915552932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-08f92b45-5306-497c-a1f3-7f10f8f0f603" returned: 0 in 0.287s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:08 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5cd71365-40fd-4a4f-9d16-c8f00fb5886c tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "cinder-quobyte-08f92b45-5306-497c-a1f3-7f10f8f0f603" released by "delete_volume" :: held 0.813s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:08 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5" returned: 0 in 0.422s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5 {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:18:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Creating direct copy from snapshot {{(pid=87128) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:18:08 devstack cinder-volume[87128]: DEBUG cinder.utils [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Path /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-281f89e7-915f-4103-815e-428b7a187116 not found in is_blk_device check {{(pid=87128) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:18:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-281f89e7-915f-4103-815e-428b7a187116 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:08 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-5cd71365-40fd-4a4f-9d16-c8f00fb5886c tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Created reservations ['a8d96606-3cb1-4776-9dfe-e87db4c1d8c2', 'ada0ea09-0213-4211-a7ff-115d62ff0022', '18336b0a-b94c-4438-b08a-353a2519b335', 'ea6d7fff-6634-490b-8c3c-4472e8a666e2'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:08 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-281f89e7-915f-4103-815e-428b7a187116 Sep 01 02:18:08 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5cd71365-40fd-4a4f-9d16-c8f00fb5886c tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5cd71365-40fd-4a4f-9d16-c8f00fb5886c tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5cd71365-40fd-4a4f-9d16-c8f00fb5886c tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5cd71365-40fd-4a4f-9d16-c8f00fb5886c tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5cd71365-40fd-4a4f-9d16-c8f00fb5886c tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5cd71365-40fd-4a4f-9d16-c8f00fb5886c tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:08 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:18:08 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:08 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-04ff2cb4-5f2a-4692-a8c2-e2a9ed9359f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Acquiring lock "cinder-336d3ca3-edd2-4d18-86ff-5ecdce7e5825-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:08 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-04ff2cb4-5f2a-4692-a8c2-e2a9ed9359f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "cinder-336d3ca3-edd2-4d18-86ff-5ecdce7e5825-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:09 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-04ff2cb4-5f2a-4692-a8c2-e2a9ed9359f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Acquiring lock "cinder-quobyte-336d3ca3-edd2-4d18-86ff-5ecdce7e5825" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:09 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-04ff2cb4-5f2a-4692-a8c2-e2a9ed9359f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "cinder-quobyte-336d3ca3-edd2-4d18-86ff-5ecdce7e5825" acquired by "delete_volume" :: waited 0.018s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:09 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bc5bd8-e566-45a0-b1fe-8474c18f15b9]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-04ff2cb4-5f2a-4692-a8c2-e2a9ed9359f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-336d3ca3-edd2-4d18-86ff-5ecdce7e5825 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:09 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-336d3ca3-edd2-4d18-86ff-5ecdce7e5825 Sep 01 02:18:09 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:09 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5cd71365-40fd-4a4f-9d16-c8f00fb5886c tempest-CreateVolumesFromSourceVolumeTest-915552932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.352s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:09 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-5cd71365-40fd-4a4f-9d16-c8f00fb5886c tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:09 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-5cd71365-40fd-4a4f-9d16-c8f00fb5886c tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Deleted volume successfully. Sep 01 02:18:09 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5cd71365-40fd-4a4f-9d16-c8f00fb5886c tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "cinder-08f92b45-5306-497c-a1f3-7f10f8f0f603-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:09 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-04ff2cb4-5f2a-4692-a8c2-e2a9ed9359f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-336d3ca3-edd2-4d18-86ff-5ecdce7e5825" returned: 0 in 0.817s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-04ff2cb4-5f2a-4692-a8c2-e2a9ed9359f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-336d3ca3-edd2-4d18-86ff-5ecdce7e5825 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:09 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-336d3ca3-edd2-4d18-86ff-5ecdce7e5825 Sep 01 02:18:09 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:10 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-04ff2cb4-5f2a-4692-a8c2-e2a9ed9359f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-336d3ca3-edd2-4d18-86ff-5ecdce7e5825" returned: 0 in 0.585s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:10 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-04ff2cb4-5f2a-4692-a8c2-e2a9ed9359f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "cinder-quobyte-336d3ca3-edd2-4d18-86ff-5ecdce7e5825" released by "delete_volume" :: held 1.464s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:10 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-04ff2cb4-5f2a-4692-a8c2-e2a9ed9359f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Created reservations ['6b180d4a-5c14-4eb0-9bf2-1d6355abca7e', '85448df6-e4dc-498b-9e4b-00c0d18d75bb', '2270a894-a982-461e-8e84-140a7f8c4fee', '847ac0ef-caf7-4d4b-92ac-0582b81dcb35'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-04ff2cb4-5f2a-4692-a8c2-e2a9ed9359f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-04ff2cb4-5f2a-4692-a8c2-e2a9ed9359f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:10 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-04ff2cb4-5f2a-4692-a8c2-e2a9ed9359f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:10 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-04ff2cb4-5f2a-4692-a8c2-e2a9ed9359f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-04ff2cb4-5f2a-4692-a8c2-e2a9ed9359f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-04ff2cb4-5f2a-4692-a8c2-e2a9ed9359f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:10 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:18:10 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1faf2d86-0eed-4708-9dac-c01cea8964f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Acquiring lock "cinder-667b3807-df4f-4b5a-b117-c79e587c5cf8-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1faf2d86-0eed-4708-9dac-c01cea8964f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "cinder-667b3807-df4f-4b5a-b117-c79e587c5cf8-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:11 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-04ff2cb4-5f2a-4692-a8c2-e2a9ed9359f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.713s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:11 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-04ff2cb4-5f2a-4692-a8c2-e2a9ed9359f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:11 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-04ff2cb4-5f2a-4692-a8c2-e2a9ed9359f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Deleted volume successfully. Sep 01 02:18:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1faf2d86-0eed-4708-9dac-c01cea8964f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Acquiring lock "cinder-quobyte-667b3807-df4f-4b5a-b117-c79e587c5cf8" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-04ff2cb4-5f2a-4692-a8c2-e2a9ed9359f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "cinder-336d3ca3-edd2-4d18-86ff-5ecdce7e5825-delete_volume" released by "delete_volume" :: held 2.757s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1faf2d86-0eed-4708-9dac-c01cea8964f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "cinder-quobyte-667b3807-df4f-4b5a-b117-c79e587c5cf8" acquired by "delete_volume" :: waited 0.040s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:11 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[f563b129-c3de-447f-83dc-2a2e98a2579b]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1faf2d86-0eed-4708-9dac-c01cea8964f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-667b3807-df4f-4b5a-b117-c79e587c5cf8 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:12 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-667b3807-df4f-4b5a-b117-c79e587c5cf8 Sep 01 02:18:12 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:12 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1faf2d86-0eed-4708-9dac-c01cea8964f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-667b3807-df4f-4b5a-b117-c79e587c5cf8" returned: 0 in 0.641s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1faf2d86-0eed-4708-9dac-c01cea8964f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-667b3807-df4f-4b5a-b117-c79e587c5cf8 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:12 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-667b3807-df4f-4b5a-b117-c79e587c5cf8 Sep 01 02:18:12 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:13 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1faf2d86-0eed-4708-9dac-c01cea8964f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-667b3807-df4f-4b5a-b117-c79e587c5cf8" returned: 0 in 0.571s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:13 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1faf2d86-0eed-4708-9dac-c01cea8964f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "cinder-quobyte-667b3807-df4f-4b5a-b117-c79e587c5cf8" released by "delete_volume" :: held 1.334s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:13 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-1faf2d86-0eed-4708-9dac-c01cea8964f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Created reservations ['8b0713ca-83ce-4716-89e8-36ca24d9ade3', '6624312b-f869-4cd1-a260-de28024b8a85', '25a51a8a-d71b-438c-b06d-11991705d8c2', 'bcd50c55-44b6-402f-99e2-068f36bfb555'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1faf2d86-0eed-4708-9dac-c01cea8964f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1faf2d86-0eed-4708-9dac-c01cea8964f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:13 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1faf2d86-0eed-4708-9dac-c01cea8964f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:13 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1faf2d86-0eed-4708-9dac-c01cea8964f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1faf2d86-0eed-4708-9dac-c01cea8964f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1faf2d86-0eed-4708-9dac-c01cea8964f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:13 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:18:13 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:13 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1faf2d86-0eed-4708-9dac-c01cea8964f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.472s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:13 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-1faf2d86-0eed-4708-9dac-c01cea8964f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:13 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-1faf2d86-0eed-4708-9dac-c01cea8964f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Deleted volume successfully. Sep 01 02:18:13 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=190,cinder:UPDATE=283,cinder:INSERT=69,cinder:DELETE=22 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:18:13 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1faf2d86-0eed-4708-9dac-c01cea8964f4 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "cinder-667b3807-df4f-4b5a-b117-c79e587c5cf8-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-10ee098b-f7f8-4977-aaf1-85313a67cfa2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Acquiring lock "cinder-59bc2523-f0e8-4de5-ae06-1f1b076a81a1-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:14 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-281f89e7-915f-4103-815e-428b7a187116" returned: 0 in 5.432s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5, size 1024.00 MB, duration 5.44 sec, destination /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-281f89e7-915f-4103-815e-428b7a187116 {{(pid=87128) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:18:14 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Converted 1024.00 MB image at 188.40 MB/s Sep 01 02:18:14 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-281f89e7-915f-4103-815e-428b7a187116 is being set with open permissions: ugo+rw Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-281f89e7-915f-4103-815e-428b7a187116 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-10ee098b-f7f8-4977-aaf1-85313a67cfa2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "cinder-59bc2523-f0e8-4de5-ae06-1f1b076a81a1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:14 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-281f89e7-915f-4103-815e-428b7a187116 Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=197,cinder:UPDATE=241,cinder:DELETE=26,cinder:INSERT=65 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:18:14 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-10ee098b-f7f8-4977-aaf1-85313a67cfa2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Acquiring lock "cinder-quobyte-59bc2523-f0e8-4de5-ae06-1f1b076a81a1" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-10ee098b-f7f8-4977-aaf1-85313a67cfa2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "cinder-quobyte-59bc2523-f0e8-4de5-ae06-1f1b076a81a1" acquired by "delete_volume" :: waited 0.019s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a09855-1b13-4a2e-ab68-13e9c692eaaa]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-10ee098b-f7f8-4977-aaf1-85313a67cfa2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59bc2523-f0e8-4de5-ae06-1f1b076a81a1 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:14 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59bc2523-f0e8-4de5-ae06-1f1b076a81a1 Sep 01 02:18:14 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:14 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-281f89e7-915f-4103-815e-428b7a187116" returned: 0 in 0.284s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Lock "cinder-quobyte-281f89e7-915f-4103-815e-428b7a187116" released by "_copy_volume_from_snapshot" :: held 6.685s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Lock "cinder-quobyte-bd53e084-64df-4d7c-8df6-16e858176a0f-281f89e7-915f-4103-815e-428b7a187116" released by "_create_volume_from_snapshot" :: held 6.772s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.791s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.263s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa28539b-b2d3-4e32-a4c6-99ef86de0a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='851bd101242f4b3cb1530c2ef0c36dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:06Z,use_quota=True,user_id='eb6f1b61fc894f018642fe9f1496502a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Creating volume fa28539b-b2d3-4e32-a4c6-99ef86de0a0a {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:14 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fa28539b-b2d3-4e32-a4c6-99ef86de0a0a 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:14 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fa28539b-b2d3-4e32-a4c6-99ef86de0a0a 1073741824 Sep 01 02:18:14 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb75b26d-4357-486d-b1a3-7a6d897289c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-281f89e7-915f-4103-815e-428b7a187116', 'volume_size': 1, 'snapshot_id': 'bd53e084-64df-4d7c-8df6-16e858176a0f'}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a074eaba-c9e9-406f-975a-015fd0a398d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:14 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Volume volume-281f89e7-915f-4103-815e-428b7a187116 (281f89e7-915f-4103-815e-428b7a187116): created successfully Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a074eaba-c9e9-406f-975a-015fd0a398d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Flow 'volume_create_manager' (605e9a02-ed3d-43ea-9d6a-b2c31b052d02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:14 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-41d398fc-4007-4d0c-84c9-3515b05b8779 tempest-SnapshotDependencyTests-105651827 None] Created volume successfully. Sep 01 02:18:14 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-10ee098b-f7f8-4977-aaf1-85313a67cfa2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59bc2523-f0e8-4de5-ae06-1f1b076a81a1" returned: 0 in 0.404s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-10ee098b-f7f8-4977-aaf1-85313a67cfa2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59bc2523-f0e8-4de5-ae06-1f1b076a81a1 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:14 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59bc2523-f0e8-4de5-ae06-1f1b076a81a1 Sep 01 02:18:14 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:14 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-10ee098b-f7f8-4977-aaf1-85313a67cfa2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-59bc2523-f0e8-4de5-ae06-1f1b076a81a1" returned: 0 in 0.263s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:14 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-10ee098b-f7f8-4977-aaf1-85313a67cfa2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "cinder-quobyte-59bc2523-f0e8-4de5-ae06-1f1b076a81a1" released by "delete_volume" :: held 0.717s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:15 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:15 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-10ee098b-f7f8-4977-aaf1-85313a67cfa2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Created reservations ['b068f705-2a26-4d68-9ca8-8793a7ba298e', '1b742aef-f27b-4fbe-95a5-f26f8f7ba3e4', 'ee4308dc-6345-46b4-a476-7e55d4d3efab', 'f7848e2d-0ba4-4535-85ab-913ef283e41e'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fa28539b-b2d3-4e32-a4c6-99ef86de0a0a 1073741824" returned: 0 in 0.525s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fa28539b-b2d3-4e32-a4c6-99ef86de0a0a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:15 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fa28539b-b2d3-4e32-a4c6-99ef86de0a0a Sep 01 02:18:15 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-10ee098b-f7f8-4977-aaf1-85313a67cfa2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-10ee098b-f7f8-4977-aaf1-85313a67cfa2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:15 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-10ee098b-f7f8-4977-aaf1-85313a67cfa2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:15 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-10ee098b-f7f8-4977-aaf1-85313a67cfa2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-10ee098b-f7f8-4977-aaf1-85313a67cfa2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-10ee098b-f7f8-4977-aaf1-85313a67cfa2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:15 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:18:15 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:15 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:15 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-33378f7c-29ae-401a-a9a9-35e32022dd3b tempest-SnapshotDependencyTests-105651827 None] Acquiring lock "cinder-bd53e084-64df-4d7c-8df6-16e858176a0f-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fa28539b-b2d3-4e32-a4c6-99ef86de0a0a" returned: 0 in 0.317s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:15 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:15 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-33378f7c-29ae-401a-a9a9-35e32022dd3b tempest-SnapshotDependencyTests-105651827 None] Lock "cinder-bd53e084-64df-4d7c-8df6-16e858176a0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:15 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-33378f7c-29ae-401a-a9a9-35e32022dd3b tempest-SnapshotDependencyTests-105651827 None] Acquiring lock "cinder-quobyte-db7a7930-b875-4291-9245-b82da2cae8e5" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:15 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-33378f7c-29ae-401a-a9a9-35e32022dd3b tempest-SnapshotDependencyTests-105651827 None] Lock "cinder-quobyte-db7a7930-b875-4291-9245-b82da2cae8e5" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:15 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-33378f7c-29ae-401a-a9a9-35e32022dd3b tempest-SnapshotDependencyTests-105651827 None] Acquiring lock "cinder-quobyte-bd53e084-64df-4d7c-8df6-16e858176a0f" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:15 devstack cinder-volume[87128]: DEBUG cinder.volume.volume_utils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Attempting download of ec36edad-9f57-4d49-845b-390b3fc2271f ((None, [{'url': 'file:///opt/stack/data/glance/images/ec36edad-9f57-4d49-845b-390b3fc2271f', 'metadata': {}}])) to volume fa28539b-b2d3-4e32-a4c6-99ef86de0a0a. {{(pid=87128) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:18:15 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-33378f7c-29ae-401a-a9a9-35e32022dd3b tempest-SnapshotDependencyTests-105651827 None] Lock "cinder-quobyte-bd53e084-64df-4d7c-8df6-16e858176a0f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:15 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-33378f7c-29ae-401a-a9a9-35e32022dd3b tempest-SnapshotDependencyTests-105651827 None] Deleting offline snapshot bd53e084-64df-4d7c-8df6-16e858176a0f of volume db7a7930-b875-4291-9245-b82da2cae8e5 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:18:15 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-33378f7c-29ae-401a-a9a9-35e32022dd3b tempest-SnapshotDependencyTests-105651827 None] snapshot_file for this snap is: volume-db7a7930-b875-4291-9245-b82da2cae8e5.bd53e084-64df-4d7c-8df6-16e858176a0f {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:18:15 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[600adeb8-81a7-48a6-a5a0-4feca3940ae0]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-33378f7c-29ae-401a-a9a9-35e32022dd3b tempest-SnapshotDependencyTests-105651827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5.bd53e084-64df-4d7c-8df6-16e858176a0f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:15 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:15 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[9309e88d-9957-4227-af4a-2dad3c9ffa9b]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-10ee098b-f7f8-4977-aaf1-85313a67cfa2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.462s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ec36edad-9f57-4d49-845b-390b3fc2271f_tm1ptee4 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:15 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-10ee098b-f7f8-4977-aaf1-85313a67cfa2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:15 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-10ee098b-f7f8-4977-aaf1-85313a67cfa2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Deleted volume successfully. Sep 01 02:18:15 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-10ee098b-f7f8-4977-aaf1-85313a67cfa2 tempest-CreateVolumesFromSourceVolumeTest-915552932 None] Lock "cinder-59bc2523-f0e8-4de5-ae06-1f1b076a81a1-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:15 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5.bd53e084-64df-4d7c-8df6-16e858176a0f Sep 01 02:18:15 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:15 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ec36edad-9f57-4d49-845b-390b3fc2271f_tm1ptee4 Sep 01 02:18:15 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:16 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-33378f7c-29ae-401a-a9a9-35e32022dd3b tempest-SnapshotDependencyTests-105651827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5.bd53e084-64df-4d7c-8df6-16e858176a0f" returned: 0 in 0.465s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-33378f7c-29ae-401a-a9a9-35e32022dd3b tempest-SnapshotDependencyTests-105651827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db7a7930-b875-4291-9245-b82da2cae8e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:18:16 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ec36edad-9f57-4d49-845b-390b3fc2271f_tm1ptee4" returned: 0 in 0.455s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec36edad-9f57-4d49-845b-390b3fc2271f_tm1ptee4 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:16 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a26a3b-953d-4ca7-81df-83b922e84790]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-33378f7c-29ae-401a-a9a9-35e32022dd3b tempest-SnapshotDependencyTests-105651827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:16 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec36edad-9f57-4d49-845b-390b3fc2271f_tm1ptee4 Sep 01 02:18:16 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:16 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5 Sep 01 02:18:16 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:16 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec36edad-9f57-4d49-845b-390b3fc2271f_tm1ptee4" returned: 1 in 0.382s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec36edad-9f57-4d49-845b-390b3fc2271f_tm1ptee4' failed. Not Retrying. {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:18:16 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44bbc29-738c-483d-a2fd-6308c22f8149]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec36edad-9f57-4d49-845b-390b3fc2271f_6uxa6mecdevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:16 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec36edad-9f57-4d49-845b-390b3fc2271f_6uxa6mecdevstack@QuobyteHD Sep 01 02:18:16 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:16 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-33378f7c-29ae-401a-a9a9-35e32022dd3b tempest-SnapshotDependencyTests-105651827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5" returned: 0 in 0.695s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-33378f7c-29ae-401a-a9a9-35e32022dd3b tempest-SnapshotDependencyTests-105651827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5.bd53e084-64df-4d7c-8df6-16e858176a0f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:16 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5.bd53e084-64df-4d7c-8df6-16e858176a0f Sep 01 02:18:16 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:16 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec36edad-9f57-4d49-845b-390b3fc2271f_6uxa6mecdevstack@QuobyteHD" returned: 0 in 0.448s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec36edad-9f57-4d49-845b-390b3fc2271f_6uxa6mecdevstack@QuobyteHD {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:16 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:18:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:17 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:18:17 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:17 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec36edad-9f57-4d49-845b-390b3fc2271f_6uxa6mecdevstack@QuobyteHD Sep 01 02:18:17 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:17 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-33378f7c-29ae-401a-a9a9-35e32022dd3b tempest-SnapshotDependencyTests-105651827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5.bd53e084-64df-4d7c-8df6-16e858176a0f" returned: 0 in 0.467s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-33378f7c-29ae-401a-a9a9-35e32022dd3b tempest-SnapshotDependencyTests-105651827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5.bd53e084-64df-4d7c-8df6-16e858176a0f {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:17 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5.bd53e084-64df-4d7c-8df6-16e858176a0f Sep 01 02:18:17 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:17 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.325s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:17 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:17 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager._thread_info {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:18:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread count: 29 {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:18:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread info: [<_MainThread(MainThread, started 128688016527488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:18:17 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec36edad-9f57-4d49-845b-390b3fc2271f_6uxa6mecdevstack@QuobyteHD" returned: 1 in 0.492s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec36edad-9f57-4d49-845b-390b3fc2271f_6uxa6mecdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:18:17 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] ec36edad-9f57-4d49-845b-390b3fc2271f was raw, converting to qcow2 {{(pid=87128) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:18:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ec36edad-9f57-4d49-845b-390b3fc2271f_6uxa6mecdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fa28539b-b2d3-4e32-a4c6-99ef86de0a0a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:17 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ec36edad-9f57-4d49-845b-390b3fc2271f_6uxa6mecdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fa28539b-b2d3-4e32-a4c6-99ef86de0a0a Sep 01 02:18:17 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:17 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-33378f7c-29ae-401a-a9a9-35e32022dd3b tempest-SnapshotDependencyTests-105651827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5.bd53e084-64df-4d7c-8df6-16e858176a0f" returned: 0 in 0.340s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:17 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-33378f7c-29ae-401a-a9a9-35e32022dd3b tempest-SnapshotDependencyTests-105651827 None] Lock "cinder-quobyte-bd53e084-64df-4d7c-8df6-16e858176a0f" released by "_delete_snapshot" :: held 2.134s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:17 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-33378f7c-29ae-401a-a9a9-35e32022dd3b tempest-SnapshotDependencyTests-105651827 None] Lock "cinder-quobyte-db7a7930-b875-4291-9245-b82da2cae8e5" released by "delete_snapshot" :: held 2.172s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:17 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-33378f7c-29ae-401a-a9a9-35e32022dd3b tempest-SnapshotDependencyTests-105651827 None] Created reservations ['277f1fb4-1af1-4292-adaa-3d5949d52248', '74c72eee-0996-4c1c-a8d8-0f5a00d2f5b7', '4ec99627-bc88-44ef-830b-fc8ed73ea0e0', '5f9c4e9f-b910-4d5f-9480-e4e6ef83d100'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:17 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-33378f7c-29ae-401a-a9a9-35e32022dd3b tempest-SnapshotDependencyTests-105651827 None] Delete snapshot completed successfully. Sep 01 02:18:17 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-33378f7c-29ae-401a-a9a9-35e32022dd3b tempest-SnapshotDependencyTests-105651827 None] Lock "cinder-bd53e084-64df-4d7c-8df6-16e858176a0f-delete_snapshot" released by "delete_snapshot" :: held 2.412s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:18 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ec36edad-9f57-4d49-845b-390b3fc2271f_6uxa6mecdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fa28539b-b2d3-4e32-a4c6-99ef86de0a0a" returned: 0 in 0.627s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:18 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ec36edad-9f57-4d49-845b-390b3fc2271f_6uxa6mecdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fa28539b-b2d3-4e32-a4c6-99ef86de0a0a {{(pid=87128) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:18:18 devstack cinder-volume[87128]: INFO cinder.image.image_utils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 02:18:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fa28539b-b2d3-4e32-a4c6-99ef86de0a0a 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:18 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fa28539b-b2d3-4e32-a4c6-99ef86de0a0a 1G Sep 01 02:18:18 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:18 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fa28539b-b2d3-4e32-a4c6-99ef86de0a0a 1G" returned: 0 in 0.346s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:18 devstack cinder-volume[87128]: DEBUG cinder.volume.volume_utils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Downloaded image ec36edad-9f57-4d49-845b-390b3fc2271f ((None, [{'url': 'file:///opt/stack/data/glance/images/ec36edad-9f57-4d49-845b-390b3fc2271f', 'metadata': {}}])) to volume fa28539b-b2d3-4e32-a4c6-99ef86de0a0a successfully. {{(pid=87128) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:18:18 devstack cinder-volume[87128]: DEBUG cinder.image.image_utils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Temporary image ec36edad-9f57-4d49-845b-390b3fc2271f for user eb6f1b61fc894f018642fe9f1496502a is deleted. {{(pid=87128) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:18:18 devstack cinder-volume[87128]: DEBUG cinder.volume.volume_utils [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Marking volume fa28539b-b2d3-4e32-a4c6-99ef86de0a0a as bootable. {{(pid=87128) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:18:18 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Copying metadata from image ec36edad-9f57-4d49-845b-390b3fc2271f to fa28539b-b2d3-4e32-a4c6-99ef86de0a0a. {{(pid=87128) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:18:18 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Creating volume glance metadata for volume fa28539b-b2d3-4e32-a4c6-99ef86de0a0a backed by image ec36edad-9f57-4d49-845b-390b3fc2271f with: {'image_id': 'ec36edad-9f57-4d49-845b-390b3fc2271f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0d460e83f9133ea11f8678412e956542', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87128) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:18:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3452750-2769-413f-928a-6ca04e1a208b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa28539b-b2d3-4e32-a4c6-99ef86de0a0a', 'volume_size': 1, 'image_id': 'ec36edad-9f57-4d49-845b-390b3fc2271f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ec36edad-9f57-4d49-845b-390b3fc2271f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0d460e83f9133ea11f8678412e956542', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '851bd101242f4b3cb1530c2ef0c36dd2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3cea509b3e9bcfef041075d405a62fd20d49dbe7c2c9021954f31d773c08c6d8ab864a5bea91f61fda8be1d449b83c8414b62e7051b8a9bbbceda51f3eae1e65', 'id': 'ec36edad-9f57-4d49-845b-390b3fc2271f', 'created_at': datetime.datetime(2026, 9, 1, 0, 18, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 18, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ec36edad-9f57-4d49-845b-390b3fc2271f/file', 'properties': {}}, 'image_service': }' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbe62e11-543a-461a-b989-08f68bdf6389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:18 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Volume volume-fa28539b-b2d3-4e32-a4c6-99ef86de0a0a (fa28539b-b2d3-4e32-a4c6-99ef86de0a0a): created successfully Sep 01 02:18:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbe62e11-543a-461a-b989-08f68bdf6389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:18 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Flow 'volume_create_manager' (84eca7a9-7308-4373-ad35-e583a5c6bcfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:18 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-c4e4dd28-dd56-4055-807c-53f5b7c1f341 tempest-VolumeImageDependencyTests-40464305 None] Created volume successfully. Sep 01 02:18:18 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c9699a88-cf2c-482c-ac54-a6fa32e8aace tempest-SnapshotDependencyTests-105651827 None] Acquiring lock "cinder-db7a7930-b875-4291-9245-b82da2cae8e5-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:18 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c9699a88-cf2c-482c-ac54-a6fa32e8aace tempest-SnapshotDependencyTests-105651827 None] Lock "cinder-db7a7930-b875-4291-9245-b82da2cae8e5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:18 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c9699a88-cf2c-482c-ac54-a6fa32e8aace tempest-SnapshotDependencyTests-105651827 None] Acquiring lock "cinder-quobyte-db7a7930-b875-4291-9245-b82da2cae8e5" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:18 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c9699a88-cf2c-482c-ac54-a6fa32e8aace tempest-SnapshotDependencyTests-105651827 None] Lock "cinder-quobyte-db7a7930-b875-4291-9245-b82da2cae8e5" acquired by "delete_volume" :: waited 0.025s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:18 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae30573-c6d7-4974-979d-846d18b24a33]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c9699a88-cf2c-482c-ac54-a6fa32e8aace tempest-SnapshotDependencyTests-105651827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:18 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5 Sep 01 02:18:18 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] Flow 'volume_create_manager' (813df760-61f5-4e8a-93e8-f27fae7d16ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa284433-25d6-4117-aff7-7ec07b8dd8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1302cdb7-1c5f-49f0-98fe-7b2ded0eaa21 tempest-VolumeImageDependencyTests-40464305 None] Acquiring lock "cinder-fa28539b-b2d3-4e32-a4c6-99ef86de0a0a-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa284433-25d6-4117-aff7-7ec07b8dd8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1651258298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efb19a76-b406-43c7-9bef-da3d2d8307e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61578a8868584ca29ab081523d408c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:19Z,use_quota=True,user_id='f2911f91e5124a7ba8862f4b148bf6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50939f37-e443-4a7f-ac46-757fce24afc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50939f37-e443-4a7f-ac46-757fce24afc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62fd7e44-156a-43ba-8535-9a8a36a370d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62fd7e44-156a-43ba-8535-9a8a36a370d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efb19a76-b406-43c7-9bef-da3d2d8307e1', 'volume_name': 'volume-efb19a76-b406-43c7-9bef-da3d2d8307e1', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (453d92ac-c5df-4ec8-8c30-37b8635a759f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (453d92ac-c5df-4ec8-8c30-37b8635a759f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54edda5c-0393-4c50-b701-81e724a4d3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:19 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] Volume efb19a76-b406-43c7-9bef-da3d2d8307e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efb19a76-b406-43c7-9bef-da3d2d8307e1', 'volume_size': 1} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1651258298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efb19a76-b406-43c7-9bef-da3d2d8307e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61578a8868584ca29ab081523d408c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:19Z,use_quota=True,user_id='f2911f91e5124a7ba8862f4b148bf6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] Creating volume efb19a76-b406-43c7-9bef-da3d2d8307e1 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:19 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1302cdb7-1c5f-49f0-98fe-7b2ded0eaa21 tempest-VolumeImageDependencyTests-40464305 None] Lock "cinder-fa28539b-b2d3-4e32-a4c6-99ef86de0a0a-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:19 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1 1073741824 Sep 01 02:18:19 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:19 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1302cdb7-1c5f-49f0-98fe-7b2ded0eaa21 tempest-VolumeImageDependencyTests-40464305 None] Acquiring lock "cinder-quobyte-fa28539b-b2d3-4e32-a4c6-99ef86de0a0a" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c9699a88-cf2c-482c-ac54-a6fa32e8aace tempest-SnapshotDependencyTests-105651827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5" returned: 0 in 0.488s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c9699a88-cf2c-482c-ac54-a6fa32e8aace tempest-SnapshotDependencyTests-105651827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1302cdb7-1c5f-49f0-98fe-7b2ded0eaa21 tempest-VolumeImageDependencyTests-40464305 None] Lock "cinder-quobyte-fa28539b-b2d3-4e32-a4c6-99ef86de0a0a" acquired by "delete_volume" :: waited 0.027s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:19 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5 Sep 01 02:18:19 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26693e7-e932-496e-8966-73fb2084f8d7]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1302cdb7-1c5f-49f0-98fe-7b2ded0eaa21 tempest-VolumeImageDependencyTests-40464305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fa28539b-b2d3-4e32-a4c6-99ef86de0a0a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:19 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fa28539b-b2d3-4e32-a4c6-99ef86de0a0a Sep 01 02:18:19 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:19 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c9699a88-cf2c-482c-ac54-a6fa32e8aace tempest-SnapshotDependencyTests-105651827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db7a7930-b875-4291-9245-b82da2cae8e5" returned: 0 in 0.287s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c9699a88-cf2c-482c-ac54-a6fa32e8aace tempest-SnapshotDependencyTests-105651827 None] Lock "cinder-quobyte-db7a7930-b875-4291-9245-b82da2cae8e5" released by "delete_volume" :: held 0.848s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-c9699a88-cf2c-482c-ac54-a6fa32e8aace tempest-SnapshotDependencyTests-105651827 None] Created reservations ['4b1d0a6f-abcf-49f6-af04-9cb052cf21f7', 'c8acff7f-cc39-4bf1-8316-4f7ea738039f', 'a1ded76f-7f90-4b4f-9e73-c9302e7bc848', '000fc41f-7ca3-43f8-ab3a-fb503a74c689'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c9699a88-cf2c-482c-ac54-a6fa32e8aace tempest-SnapshotDependencyTests-105651827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c9699a88-cf2c-482c-ac54-a6fa32e8aace tempest-SnapshotDependencyTests-105651827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c9699a88-cf2c-482c-ac54-a6fa32e8aace tempest-SnapshotDependencyTests-105651827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c9699a88-cf2c-482c-ac54-a6fa32e8aace tempest-SnapshotDependencyTests-105651827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c9699a88-cf2c-482c-ac54-a6fa32e8aace tempest-SnapshotDependencyTests-105651827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c9699a88-cf2c-482c-ac54-a6fa32e8aace tempest-SnapshotDependencyTests-105651827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:19 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:18:19 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:19 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1 1073741824" returned: 0 in 0.634s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:19 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1302cdb7-1c5f-49f0-98fe-7b2ded0eaa21 tempest-VolumeImageDependencyTests-40464305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fa28539b-b2d3-4e32-a4c6-99ef86de0a0a" returned: 0 in 0.533s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1302cdb7-1c5f-49f0-98fe-7b2ded0eaa21 tempest-VolumeImageDependencyTests-40464305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fa28539b-b2d3-4e32-a4c6-99ef86de0a0a {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bbb47983-4682-4d92-b413-e078dbb4fe08 tempest-SnapshotDependencyTests-105651827 None] Acquiring lock "cinder-281f89e7-915f-4103-815e-428b7a187116-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:19 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fa28539b-b2d3-4e32-a4c6-99ef86de0a0a Sep 01 02:18:19 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bbb47983-4682-4d92-b413-e078dbb4fe08 tempest-SnapshotDependencyTests-105651827 None] Lock "cinder-281f89e7-915f-4103-815e-428b7a187116-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:19 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1 Sep 01 02:18:19 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bbb47983-4682-4d92-b413-e078dbb4fe08 tempest-SnapshotDependencyTests-105651827 None] Acquiring lock "cinder-quobyte-281f89e7-915f-4103-815e-428b7a187116" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bbb47983-4682-4d92-b413-e078dbb4fe08 tempest-SnapshotDependencyTests-105651827 None] Lock "cinder-quobyte-281f89e7-915f-4103-815e-428b7a187116" acquired by "delete_volume" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4c6ae0-1c70-4dfb-8963-4772d9363d2d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bbb47983-4682-4d92-b413-e078dbb4fe08 tempest-SnapshotDependencyTests-105651827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-281f89e7-915f-4103-815e-428b7a187116 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:20 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-281f89e7-915f-4103-815e-428b7a187116 Sep 01 02:18:20 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:20 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c9699a88-cf2c-482c-ac54-a6fa32e8aace tempest-SnapshotDependencyTests-105651827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.413s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-c9699a88-cf2c-482c-ac54-a6fa32e8aace tempest-SnapshotDependencyTests-105651827 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:20 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-c9699a88-cf2c-482c-ac54-a6fa32e8aace tempest-SnapshotDependencyTests-105651827 None] Deleted volume successfully. Sep 01 02:18:20 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:20 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1302cdb7-1c5f-49f0-98fe-7b2ded0eaa21 tempest-VolumeImageDependencyTests-40464305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fa28539b-b2d3-4e32-a4c6-99ef86de0a0a" returned: 0 in 0.349s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1" returned: 0 in 0.317s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54edda5c-0393-4c50-b701-81e724a4d3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efb19a76-b406-43c7-9bef-da3d2d8307e1', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b7d4577-18c4-41a3-9c70-ab99ff3c84e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1302cdb7-1c5f-49f0-98fe-7b2ded0eaa21 tempest-VolumeImageDependencyTests-40464305 None] Lock "cinder-quobyte-fa28539b-b2d3-4e32-a4c6-99ef86de0a0a" released by "delete_volume" :: held 0.978s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c9699a88-cf2c-482c-ac54-a6fa32e8aace tempest-SnapshotDependencyTests-105651827 None] Lock "cinder-db7a7930-b875-4291-9245-b82da2cae8e5-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:20 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] Volume volume-efb19a76-b406-43c7-9bef-da3d2d8307e1 (efb19a76-b406-43c7-9bef-da3d2d8307e1): created successfully Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b7d4577-18c4-41a3-9c70-ab99ff3c84e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] Flow 'volume_create_manager' (813df760-61f5-4e8a-93e8-f27fae7d16ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:20 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-d9bd10fb-077c-4bbd-8507-0dc485d1ae2e tempest-ProjectMemberTests-1927748625 None] Created volume successfully. Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-1302cdb7-1c5f-49f0-98fe-7b2ded0eaa21 tempest-VolumeImageDependencyTests-40464305 None] Created reservations ['12f3f15c-c273-45c9-8ca2-de69992cad1c', 'f38faff0-1e58-469b-9e92-ae0829c523ce', '8cc8d75f-7918-471c-97e0-e145402a5687', 'cbf4e59d-e4f6-43c3-bb41-bb17d3018602'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1302cdb7-1c5f-49f0-98fe-7b2ded0eaa21 tempest-VolumeImageDependencyTests-40464305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1302cdb7-1c5f-49f0-98fe-7b2ded0eaa21 tempest-VolumeImageDependencyTests-40464305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1302cdb7-1c5f-49f0-98fe-7b2ded0eaa21 tempest-VolumeImageDependencyTests-40464305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-1302cdb7-1c5f-49f0-98fe-7b2ded0eaa21 tempest-VolumeImageDependencyTests-40464305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-1302cdb7-1c5f-49f0-98fe-7b2ded0eaa21 tempest-VolumeImageDependencyTests-40464305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1302cdb7-1c5f-49f0-98fe-7b2ded0eaa21 tempest-VolumeImageDependencyTests-40464305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:20 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:18:20 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:20 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bbb47983-4682-4d92-b413-e078dbb4fe08 tempest-SnapshotDependencyTests-105651827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-281f89e7-915f-4103-815e-428b7a187116" returned: 0 in 0.442s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bbb47983-4682-4d92-b413-e078dbb4fe08 tempest-SnapshotDependencyTests-105651827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-281f89e7-915f-4103-815e-428b7a187116 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:20 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-281f89e7-915f-4103-815e-428b7a187116 Sep 01 02:18:20 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:20 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-1302cdb7-1c5f-49f0-98fe-7b2ded0eaa21 tempest-VolumeImageDependencyTests-40464305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.281s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-1302cdb7-1c5f-49f0-98fe-7b2ded0eaa21 tempest-VolumeImageDependencyTests-40464305 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:20 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-1302cdb7-1c5f-49f0-98fe-7b2ded0eaa21 tempest-VolumeImageDependencyTests-40464305 None] Deleted volume successfully. Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-1302cdb7-1c5f-49f0-98fe-7b2ded0eaa21 tempest-VolumeImageDependencyTests-40464305 None] Lock "cinder-fa28539b-b2d3-4e32-a4c6-99ef86de0a0a-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:20 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bbb47983-4682-4d92-b413-e078dbb4fe08 tempest-SnapshotDependencyTests-105651827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-281f89e7-915f-4103-815e-428b7a187116" returned: 0 in 0.262s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bbb47983-4682-4d92-b413-e078dbb4fe08 tempest-SnapshotDependencyTests-105651827 None] Lock "cinder-quobyte-281f89e7-915f-4103-815e-428b7a187116" released by "delete_volume" :: held 0.781s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-bbb47983-4682-4d92-b413-e078dbb4fe08 tempest-SnapshotDependencyTests-105651827 None] Created reservations ['d44a968b-1d97-436b-a1f0-cc9a689c8a77', 'c74563bd-6a79-4ce9-bab0-07a0e3d67798', '8f07f3db-7493-48ff-8162-a71fe0426138', '7bdcc5c1-03a0-479b-8e91-99ecff71c0cd'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-bbb47983-4682-4d92-b413-e078dbb4fe08 tempest-SnapshotDependencyTests-105651827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-bbb47983-4682-4d92-b413-e078dbb4fe08 tempest-SnapshotDependencyTests-105651827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-bbb47983-4682-4d92-b413-e078dbb4fe08 tempest-SnapshotDependencyTests-105651827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-bbb47983-4682-4d92-b413-e078dbb4fe08 tempest-SnapshotDependencyTests-105651827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-bbb47983-4682-4d92-b413-e078dbb4fe08 tempest-SnapshotDependencyTests-105651827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bbb47983-4682-4d92-b413-e078dbb4fe08 tempest-SnapshotDependencyTests-105651827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:20 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:18:20 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:21 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-bbb47983-4682-4d92-b413-e078dbb4fe08 tempest-SnapshotDependencyTests-105651827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.277s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:21 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-bbb47983-4682-4d92-b413-e078dbb4fe08 tempest-SnapshotDependencyTests-105651827 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:21 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-bbb47983-4682-4d92-b413-e078dbb4fe08 tempest-SnapshotDependencyTests-105651827 None] Deleted volume successfully. Sep 01 02:18:21 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-bbb47983-4682-4d92-b413-e078dbb4fe08 tempest-SnapshotDependencyTests-105651827 None] Lock "cinder-281f89e7-915f-4103-815e-428b7a187116-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-adadfc5f-204e-4b4f-a25b-12e1de617389 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-adadfc5f-204e-4b4f-a25b-12e1de617389 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-adadfc5f-204e-4b4f-a25b-12e1de617389 tempest-ProjectMemberTests-1927748625 None] Creating offline snapshot f325c85e-93ae-4a9d-9a72-b1bec57fb921 of volume efb19a76-b406-43c7-9bef-da3d2d8307e1 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:18:21 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07202db-0b31-45bb-a935-bbce71f63dca]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-adadfc5f-204e-4b4f-a25b-12e1de617389 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:22 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1 Sep 01 02:18:22 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:22 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-adadfc5f-204e-4b4f-a25b-12e1de617389 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1" returned: 0 in 0.528s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-adadfc5f-204e-4b4f-a25b-12e1de617389 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1.f325c85e-93ae-4a9d-9a72-b1bec57fb921 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:22 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1.f325c85e-93ae-4a9d-9a72-b1bec57fb921 1G Sep 01 02:18:22 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:22 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-adadfc5f-204e-4b4f-a25b-12e1de617389 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1.f325c85e-93ae-4a9d-9a72-b1bec57fb921 1G" returned: 0 in 0.473s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-adadfc5f-204e-4b4f-a25b-12e1de617389 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efb19a76-b406-43c7-9bef-da3d2d8307e1 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1.f325c85e-93ae-4a9d-9a72-b1bec57fb921 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:22 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efb19a76-b406-43c7-9bef-da3d2d8307e1 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1.f325c85e-93ae-4a9d-9a72-b1bec57fb921 Sep 01 02:18:22 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:23 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-adadfc5f-204e-4b4f-a25b-12e1de617389 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efb19a76-b406-43c7-9bef-da3d2d8307e1 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1.f325c85e-93ae-4a9d-9a72-b1bec57fb921" returned: 0 in 0.413s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:23 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-adadfc5f-204e-4b4f-a25b-12e1de617389 tempest-ProjectMemberTests-1927748625 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1.f325c85e-93ae-4a9d-9a72-b1bec57fb921 is being set with open permissions: ugo+rw Sep 01 02:18:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-adadfc5f-204e-4b4f-a25b-12e1de617389 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1.f325c85e-93ae-4a9d-9a72-b1bec57fb921 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:23 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1.f325c85e-93ae-4a9d-9a72-b1bec57fb921 Sep 01 02:18:23 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:23 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-adadfc5f-204e-4b4f-a25b-12e1de617389 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1.f325c85e-93ae-4a9d-9a72-b1bec57fb921" returned: 0 in 0.363s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-adadfc5f-204e-4b4f-a25b-12e1de617389 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:23 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1.info Sep 01 02:18:23 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:24 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-adadfc5f-204e-4b4f-a25b-12e1de617389 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1.info" returned: 0 in 0.320s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:24 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-adadfc5f-204e-4b4f-a25b-12e1de617389 tempest-ProjectMemberTests-1927748625 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1.info is being set with open permissions: ugo+rw Sep 01 02:18:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-adadfc5f-204e-4b4f-a25b-12e1de617389 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:24 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1.info Sep 01 02:18:24 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:24 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-adadfc5f-204e-4b4f-a25b-12e1de617389 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1.info" returned: 0 in 0.373s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-adadfc5f-204e-4b4f-a25b-12e1de617389 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.613s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:24 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-adadfc5f-204e-4b4f-a25b-12e1de617389 tempest-ProjectMemberTests-1927748625 None] Create snapshot completed successfully Sep 01 02:18:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b7398545-15a3-4323-aff4-ff19b9096282 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-f325c85e-93ae-4a9d-9a72-b1bec57fb921-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b7398545-15a3-4323-aff4-ff19b9096282 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-f325c85e-93ae-4a9d-9a72-b1bec57fb921-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:24 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b7398545-15a3-4323-aff4-ff19b9096282 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-quobyte-efb19a76-b406-43c7-9bef-da3d2d8307e1" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b7398545-15a3-4323-aff4-ff19b9096282 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-efb19a76-b406-43c7-9bef-da3d2d8307e1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b7398545-15a3-4323-aff4-ff19b9096282 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-quobyte-f325c85e-93ae-4a9d-9a72-b1bec57fb921" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b7398545-15a3-4323-aff4-ff19b9096282 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-f325c85e-93ae-4a9d-9a72-b1bec57fb921" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-b7398545-15a3-4323-aff4-ff19b9096282 tempest-ProjectMemberTests-1927748625 None] Deleting offline snapshot f325c85e-93ae-4a9d-9a72-b1bec57fb921 of volume efb19a76-b406-43c7-9bef-da3d2d8307e1 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:18:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-b7398545-15a3-4323-aff4-ff19b9096282 tempest-ProjectMemberTests-1927748625 None] snapshot_file for this snap is: volume-efb19a76-b406-43c7-9bef-da3d2d8307e1.f325c85e-93ae-4a9d-9a72-b1bec57fb921 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:18:25 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebdf388-3c83-49aa-97c4-edcfdc3d9882]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b7398545-15a3-4323-aff4-ff19b9096282 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1.f325c85e-93ae-4a9d-9a72-b1bec57fb921 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:25 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1.f325c85e-93ae-4a9d-9a72-b1bec57fb921 Sep 01 02:18:25 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:25 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b7398545-15a3-4323-aff4-ff19b9096282 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1.f325c85e-93ae-4a9d-9a72-b1bec57fb921" returned: 0 in 0.421s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-b7398545-15a3-4323-aff4-ff19b9096282 tempest-ProjectMemberTests-1927748625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efb19a76-b406-43c7-9bef-da3d2d8307e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:18:25 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f56cfc-75a5-40d4-a088-c8de6399529b]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b7398545-15a3-4323-aff4-ff19b9096282 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:25 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1 Sep 01 02:18:25 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:26 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b7398545-15a3-4323-aff4-ff19b9096282 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1" returned: 0 in 0.505s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b7398545-15a3-4323-aff4-ff19b9096282 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1.f325c85e-93ae-4a9d-9a72-b1bec57fb921 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:26 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1.f325c85e-93ae-4a9d-9a72-b1bec57fb921 Sep 01 02:18:26 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:26 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b7398545-15a3-4323-aff4-ff19b9096282 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1.f325c85e-93ae-4a9d-9a72-b1bec57fb921" returned: 0 in 0.456s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b7398545-15a3-4323-aff4-ff19b9096282 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1.f325c85e-93ae-4a9d-9a72-b1bec57fb921 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:26 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1.f325c85e-93ae-4a9d-9a72-b1bec57fb921 Sep 01 02:18:26 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:26 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b7398545-15a3-4323-aff4-ff19b9096282 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1.f325c85e-93ae-4a9d-9a72-b1bec57fb921" returned: 0 in 0.430s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:27 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b7398545-15a3-4323-aff4-ff19b9096282 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-f325c85e-93ae-4a9d-9a72-b1bec57fb921" released by "_delete_snapshot" :: held 1.985s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:27 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b7398545-15a3-4323-aff4-ff19b9096282 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-efb19a76-b406-43c7-9bef-da3d2d8307e1" released by "delete_snapshot" :: held 2.013s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:27 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-b7398545-15a3-4323-aff4-ff19b9096282 tempest-ProjectMemberTests-1927748625 None] Created reservations ['c5f971d7-3d7b-4c93-80e4-3d82bc175fcb', '39ba4ffd-9169-4e9a-a05f-c14617f97ec8', '4d89990e-07db-4b44-9d94-2c6c06274714', 'bb939636-40ea-40a7-83d7-6ee0db4b9190'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:27 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-b7398545-15a3-4323-aff4-ff19b9096282 tempest-ProjectMemberTests-1927748625 None] Delete snapshot completed successfully. Sep 01 02:18:27 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-b7398545-15a3-4323-aff4-ff19b9096282 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-f325c85e-93ae-4a9d-9a72-b1bec57fb921-delete_snapshot" released by "delete_snapshot" :: held 2.213s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:27 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] Flow 'volume_create_manager' (20b874e4-bd74-4847-b2f1-30831d1f8785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a6cee5-469f-4214-934e-773264e3fe09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a6cee5-469f-4214-934e-773264e3fe09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2047416617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b413835-d98d-411c-b465-f163878a8f73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d058dbf4e44e93bebda8c4e31386c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:27Z,use_quota=True,user_id='b9d99efedc644ff2a9d2817061a6b9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d5b6b59-e22b-4b93-bb8a-a8bc0204886c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d5b6b59-e22b-4b93-bb8a-a8bc0204886c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5a56adf-59cb-4202-92b6-39fdc244e5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5a56adf-59cb-4202-92b6-39fdc244e5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b413835-d98d-411c-b465-f163878a8f73', 'volume_name': 'volume-2b413835-d98d-411c-b465-f163878a8f73', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a37e4971-e28b-40a6-b34c-95fa72c166e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a37e4971-e28b-40a6-b34c-95fa72c166e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:27 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72af4cb2-2fe8-4eb0-9d4f-444de4429d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:27 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] Volume 2b413835-d98d-411c-b465-f163878a8f73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b413835-d98d-411c-b465-f163878a8f73', 'volume_size': 1} Sep 01 02:18:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2047416617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b413835-d98d-411c-b465-f163878a8f73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d058dbf4e44e93bebda8c4e31386c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:27Z,use_quota=True,user_id='b9d99efedc644ff2a9d2817061a6b9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] Creating volume 2b413835-d98d-411c-b465-f163878a8f73 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:27 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:27 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:18:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:27 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73 1073741824 Sep 01 02:18:27 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:27 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73 1073741824" returned: 0 in 0.521s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:28 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73 Sep 01 02:18:28 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:28 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-030e19b2-85c9-4480-ab62-d9684396f531 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-efb19a76-b406-43c7-9bef-da3d2d8307e1-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:28 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-030e19b2-85c9-4480-ab62-d9684396f531 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-efb19a76-b406-43c7-9bef-da3d2d8307e1-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:28 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-030e19b2-85c9-4480-ab62-d9684396f531 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-quobyte-efb19a76-b406-43c7-9bef-da3d2d8307e1" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:28 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-030e19b2-85c9-4480-ab62-d9684396f531 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-efb19a76-b406-43c7-9bef-da3d2d8307e1" acquired by "delete_volume" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:28 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73" returned: 0 in 0.379s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:28 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72af4cb2-2fe8-4eb0-9d4f-444de4429d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b413835-d98d-411c-b465-f163878a8f73', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcf5b1db-2c88-4535-9769-298e2019e6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:28 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[7820c320-3767-461f-a565-533e127b4853]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-030e19b2-85c9-4480-ab62-d9684396f531 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:28 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] Volume volume-2b413835-d98d-411c-b465-f163878a8f73 (2b413835-d98d-411c-b465-f163878a8f73): created successfully Sep 01 02:18:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcf5b1db-2c88-4535-9769-298e2019e6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:28 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] Flow 'volume_create_manager' (20b874e4-bd74-4847-b2f1-30831d1f8785) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:28 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-f5dd4f95-ddac-424e-b336-e6749366bd7f tempest-ProjectReaderTests-1438211366 None] Created volume successfully. Sep 01 02:18:28 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1 Sep 01 02:18:28 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:28 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-030e19b2-85c9-4480-ab62-d9684396f531 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1" returned: 0 in 0.551s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-030e19b2-85c9-4480-ab62-d9684396f531 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:29 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1 Sep 01 02:18:29 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:29 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-030e19b2-85c9-4480-ab62-d9684396f531 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-efb19a76-b406-43c7-9bef-da3d2d8307e1" returned: 0 in 0.295s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:29 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-030e19b2-85c9-4480-ab62-d9684396f531 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-efb19a76-b406-43c7-9bef-da3d2d8307e1" released by "delete_volume" :: held 0.937s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:29 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-030e19b2-85c9-4480-ab62-d9684396f531 tempest-ProjectMemberTests-1927748625 None] Created reservations ['6efe38fc-3239-47eb-9b10-f53eb0bab353', '7d7b03dd-07af-4fee-8b99-6585d71f551b', '1ff4bec3-da32-4a10-9b83-2a16dea77cde', 'a7db80a9-b30f-4033-9f7e-b5d9e4d1a13b'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-030e19b2-85c9-4480-ab62-d9684396f531 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-030e19b2-85c9-4480-ab62-d9684396f531 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:29 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-030e19b2-85c9-4480-ab62-d9684396f531 tempest-ProjectMemberTests-1927748625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:29 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-030e19b2-85c9-4480-ab62-d9684396f531 tempest-ProjectMemberTests-1927748625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-030e19b2-85c9-4480-ab62-d9684396f531 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-030e19b2-85c9-4480-ab62-d9684396f531 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:29 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:18:29 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d310a5d0-6f3b-4965-9e3a-b15607e694f1 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d310a5d0-6f3b-4965-9e3a-b15607e694f1 tempest-ProjectReaderTests-1438211366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:29 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-d310a5d0-6f3b-4965-9e3a-b15607e694f1 tempest-ProjectReaderTests-1438211366 None] Creating offline snapshot c4394f3d-ad7b-48d0-9a2f-9c7f2aa5e047 of volume 2b413835-d98d-411c-b465-f163878a8f73 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:18:29 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[a303a06f-f704-4ef3-8fe0-cba5a07480ae]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d310a5d0-6f3b-4965-9e3a-b15607e694f1 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:29 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-030e19b2-85c9-4480-ab62-d9684396f531 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.339s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:29 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-030e19b2-85c9-4480-ab62-d9684396f531 tempest-ProjectMemberTests-1927748625 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:29 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-030e19b2-85c9-4480-ab62-d9684396f531 tempest-ProjectMemberTests-1927748625 None] Deleted volume successfully. Sep 01 02:18:29 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-030e19b2-85c9-4480-ab62-d9684396f531 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-efb19a76-b406-43c7-9bef-da3d2d8307e1-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:29 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73 Sep 01 02:18:29 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:30 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d310a5d0-6f3b-4965-9e3a-b15607e694f1 tempest-ProjectReaderTests-1438211366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73" returned: 0 in 0.481s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d310a5d0-6f3b-4965-9e3a-b15607e694f1 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73.c4394f3d-ad7b-48d0-9a2f-9c7f2aa5e047 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:30 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73.c4394f3d-ad7b-48d0-9a2f-9c7f2aa5e047 1G Sep 01 02:18:30 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:30 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d310a5d0-6f3b-4965-9e3a-b15607e694f1 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73.c4394f3d-ad7b-48d0-9a2f-9c7f2aa5e047 1G" returned: 0 in 0.452s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d310a5d0-6f3b-4965-9e3a-b15607e694f1 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b413835-d98d-411c-b465-f163878a8f73 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73.c4394f3d-ad7b-48d0-9a2f-9c7f2aa5e047 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:30 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b413835-d98d-411c-b465-f163878a8f73 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73.c4394f3d-ad7b-48d0-9a2f-9c7f2aa5e047 Sep 01 02:18:30 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:31 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d310a5d0-6f3b-4965-9e3a-b15607e694f1 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b413835-d98d-411c-b465-f163878a8f73 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73.c4394f3d-ad7b-48d0-9a2f-9c7f2aa5e047" returned: 0 in 0.375s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:31 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-d310a5d0-6f3b-4965-9e3a-b15607e694f1 tempest-ProjectReaderTests-1438211366 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73.c4394f3d-ad7b-48d0-9a2f-9c7f2aa5e047 is being set with open permissions: ugo+rw Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d310a5d0-6f3b-4965-9e3a-b15607e694f1 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73.c4394f3d-ad7b-48d0-9a2f-9c7f2aa5e047 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] Flow 'volume_create_manager' (62ebd249-5737-46cd-a78a-9aa2e3fe9cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da54ce94-c9a6-4713-80c9-3af044b8bbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:31 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73.c4394f3d-ad7b-48d0-9a2f-9c7f2aa5e047 Sep 01 02:18:31 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da54ce94-c9a6-4713-80c9-3af044b8bbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1788073401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46043042-b181-4b0b-9a74-079c170d91e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61578a8868584ca29ab081523d408c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:31Z,use_quota=True,user_id='f2911f91e5124a7ba8862f4b148bf6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399b9d87-2fbd-433d-ada0-313315ce8516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399b9d87-2fbd-433d-ada0-313315ce8516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9043ea4-bbfd-4fdc-b50d-cfc08fe81121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9043ea4-bbfd-4fdc-b50d-cfc08fe81121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46043042-b181-4b0b-9a74-079c170d91e0', 'volume_name': 'volume-46043042-b181-4b0b-9a74-079c170d91e0', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c5114b2-acf9-4228-9033-f378b2b21504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c5114b2-acf9-4228-9033-f378b2b21504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fecbeba-1e1e-47f6-846c-49c7d16daf59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:31 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] Volume 46043042-b181-4b0b-9a74-079c170d91e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46043042-b181-4b0b-9a74-079c170d91e0', 'volume_size': 1} Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] Flow 'volume_create_manager' (ac6dbc20-9592-41ee-9ad0-c479bc463145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13777d97-b357-4333-bb32-c80534f310ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13777d97-b357-4333-bb32-c80534f310ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2132628828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da7a16db-a0c8-4d1b-b10f-595f8bac6fec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='765676f79a2d46fe9f5b14dedca1adde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:31Z,use_quota=True,user_id='3a343ed7e68647ccac402b35be700886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (623beb03-b71f-44fb-a8e2-5009b8a20ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (623beb03-b71f-44fb-a8e2-5009b8a20ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d6912e-1d9b-447e-92ad-61054b34eaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d6912e-1d9b-447e-92ad-61054b34eaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da7a16db-a0c8-4d1b-b10f-595f8bac6fec', 'volume_name': 'volume-da7a16db-a0c8-4d1b-b10f-595f8bac6fec', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b9cd77c-ae1f-47cb-aa8f-01463ccebf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b9cd77c-ae1f-47cb-aa8f-01463ccebf6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb32d0b-8224-44db-ae3f-f213a585ade7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:31 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] Volume da7a16db-a0c8-4d1b-b10f-595f8bac6fec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da7a16db-a0c8-4d1b-b10f-595f8bac6fec', 'volume_size': 1} Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:31 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d310a5d0-6f3b-4965-9e3a-b15607e694f1 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73.c4394f3d-ad7b-48d0-9a2f-9c7f2aa5e047" returned: 0 in 0.327s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d310a5d0-6f3b-4965-9e3a-b15607e694f1 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:31 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73.info Sep 01 02:18:31 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:31 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d310a5d0-6f3b-4965-9e3a-b15607e694f1 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73.info" returned: 0 in 0.305s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:31 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-d310a5d0-6f3b-4965-9e3a-b15607e694f1 tempest-ProjectReaderTests-1438211366 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73.info is being set with open permissions: ugo+rw Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d310a5d0-6f3b-4965-9e3a-b15607e694f1 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:31 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73.info Sep 01 02:18:31 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:31 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d310a5d0-6f3b-4965-9e3a-b15607e694f1 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73.info" returned: 0 in 0.253s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d310a5d0-6f3b-4965-9e3a-b15607e694f1 tempest-ProjectReaderTests-1438211366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.289s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.803s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:32 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1788073401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46043042-b181-4b0b-9a74-079c170d91e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61578a8868584ca29ab081523d408c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:31Z,use_quota=True,user_id='f2911f91e5124a7ba8862f4b148bf6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:32 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] Creating volume 46043042-b181-4b0b-9a74-079c170d91e0 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:32 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:32 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:32 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:32 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:18:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:32 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0 1073741824 Sep 01 02:18:32 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:32 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-d310a5d0-6f3b-4965-9e3a-b15607e694f1 tempest-ProjectReaderTests-1438211366 None] Create snapshot completed successfully Sep 01 02:18:32 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0 1073741824" returned: 0 in 0.491s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:32 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0 Sep 01 02:18:32 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:32 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0" returned: 0 in 0.258s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:32 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.464s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:32 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2132628828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da7a16db-a0c8-4d1b-b10f-595f8bac6fec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='765676f79a2d46fe9f5b14dedca1adde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:31Z,use_quota=True,user_id='3a343ed7e68647ccac402b35be700886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:32 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] Creating volume da7a16db-a0c8-4d1b-b10f-595f8bac6fec {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:32 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:32 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:32 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:32 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:18:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-da7a16db-a0c8-4d1b-b10f-595f8bac6fec 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fecbeba-1e1e-47f6-846c-49c7d16daf59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46043042-b181-4b0b-9a74-079c170d91e0', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b55abd4d-8577-4efb-9eab-130b48a092b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:32 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-da7a16db-a0c8-4d1b-b10f-595f8bac6fec 1073741824 Sep 01 02:18:32 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:32 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] Volume volume-46043042-b181-4b0b-9a74-079c170d91e0 (46043042-b181-4b0b-9a74-079c170d91e0): created successfully Sep 01 02:18:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b55abd4d-8577-4efb-9eab-130b48a092b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:32 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] Flow 'volume_create_manager' (62ebd249-5737-46cd-a78a-9aa2e3fe9cad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:32 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-8ca2bcb6-8b58-4ee9-b78e-c5209718f1db tempest-ProjectMemberTests-1927748625 None] Created volume successfully. Sep 01 02:18:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-89e9603e-2aa5-4328-816f-30eab5fd2b71 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:33 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-da7a16db-a0c8-4d1b-b10f-595f8bac6fec 1073741824" returned: 0 in 0.608s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-da7a16db-a0c8-4d1b-b10f-595f8bac6fec {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:33 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-85a86203-4b13-4892-a49a-e4befc78c7c9 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "cinder-c4394f3d-ad7b-48d0-9a2f-9c7f2aa5e047-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:33 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-da7a16db-a0c8-4d1b-b10f-595f8bac6fec Sep 01 02:18:33 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:33 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-85a86203-4b13-4892-a49a-e4befc78c7c9 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-c4394f3d-ad7b-48d0-9a2f-9c7f2aa5e047-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:33 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-85a86203-4b13-4892-a49a-e4befc78c7c9 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "cinder-quobyte-2b413835-d98d-411c-b465-f163878a8f73" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:33 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-85a86203-4b13-4892-a49a-e4befc78c7c9 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-quobyte-2b413835-d98d-411c-b465-f163878a8f73" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:33 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-85a86203-4b13-4892-a49a-e4befc78c7c9 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "cinder-quobyte-c4394f3d-ad7b-48d0-9a2f-9c7f2aa5e047" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:33 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-85a86203-4b13-4892-a49a-e4befc78c7c9 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-quobyte-c4394f3d-ad7b-48d0-9a2f-9c7f2aa5e047" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-85a86203-4b13-4892-a49a-e4befc78c7c9 tempest-ProjectReaderTests-1438211366 None] Deleting offline snapshot c4394f3d-ad7b-48d0-9a2f-9c7f2aa5e047 of volume 2b413835-d98d-411c-b465-f163878a8f73 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:18:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-85a86203-4b13-4892-a49a-e4befc78c7c9 tempest-ProjectReaderTests-1438211366 None] snapshot_file for this snap is: volume-2b413835-d98d-411c-b465-f163878a8f73.c4394f3d-ad7b-48d0-9a2f-9c7f2aa5e047 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:18:33 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[7810204a-df05-4613-92e4-d4d635406569]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-85a86203-4b13-4892-a49a-e4befc78c7c9 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73.c4394f3d-ad7b-48d0-9a2f-9c7f2aa5e047 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:33 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73.c4394f3d-ad7b-48d0-9a2f-9c7f2aa5e047 Sep 01 02:18:33 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:33 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-da7a16db-a0c8-4d1b-b10f-595f8bac6fec" returned: 0 in 0.302s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-89e9603e-2aa5-4328-816f-30eab5fd2b71 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.433s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:33 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-89e9603e-2aa5-4328-816f-30eab5fd2b71 tempest-ProjectMemberTests-1927748625 None] Creating offline snapshot 18d213ac-7c99-43cb-bc5e-e9785935f0fd of volume 46043042-b181-4b0b-9a74-079c170d91e0 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:18:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb32d0b-8224-44db-ae3f-f213a585ade7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da7a16db-a0c8-4d1b-b10f-595f8bac6fec', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d193d0-b424-47e3-9d58-a1a6ab88141e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:33 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff8d39a-e958-4a1c-a93e-821a684b1a40]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:33 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-89e9603e-2aa5-4328-816f-30eab5fd2b71 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:33 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] Volume volume-da7a16db-a0c8-4d1b-b10f-595f8bac6fec (da7a16db-a0c8-4d1b-b10f-595f8bac6fec): created successfully Sep 01 02:18:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d193d0-b424-47e3-9d58-a1a6ab88141e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:33 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] Flow 'volume_create_manager' (ac6dbc20-9592-41ee-9ad0-c479bc463145) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:33 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-b3c38998-dc50-4f3a-9a45-9f80c6bffc8b tempest-ProjectReaderTests-1170430630 None] Created volume successfully. Sep 01 02:18:34 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0 Sep 01 02:18:34 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:34 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-85a86203-4b13-4892-a49a-e4befc78c7c9 tempest-ProjectReaderTests-1438211366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73.c4394f3d-ad7b-48d0-9a2f-9c7f2aa5e047" returned: 0 in 0.476s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:34 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-85a86203-4b13-4892-a49a-e4befc78c7c9 tempest-ProjectReaderTests-1438211366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b413835-d98d-411c-b465-f163878a8f73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:18:34 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98f8823-e344-491f-99f9-731781cc9110]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-85a86203-4b13-4892-a49a-e4befc78c7c9 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:34 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73 Sep 01 02:18:34 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:34 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-89e9603e-2aa5-4328-816f-30eab5fd2b71 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0" returned: 0 in 0.443s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-89e9603e-2aa5-4328-816f-30eab5fd2b71 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0.18d213ac-7c99-43cb-bc5e-e9785935f0fd 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:34 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0.18d213ac-7c99-43cb-bc5e-e9785935f0fd 1G Sep 01 02:18:34 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:34 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-85a86203-4b13-4892-a49a-e4befc78c7c9 tempest-ProjectReaderTests-1438211366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73" returned: 0 in 0.460s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-85a86203-4b13-4892-a49a-e4befc78c7c9 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73.c4394f3d-ad7b-48d0-9a2f-9c7f2aa5e047 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:34 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73.c4394f3d-ad7b-48d0-9a2f-9c7f2aa5e047 Sep 01 02:18:34 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-82ea48fc-c427-4fbc-937d-cd05c5add838 tempest-ProjectReaderTests-1170430630 None] Acquiring lock "cinder-da7a16db-a0c8-4d1b-b10f-595f8bac6fec-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:34 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-89e9603e-2aa5-4328-816f-30eab5fd2b71 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0.18d213ac-7c99-43cb-bc5e-e9785935f0fd 1G" returned: 0 in 0.603s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-89e9603e-2aa5-4328-816f-30eab5fd2b71 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46043042-b181-4b0b-9a74-079c170d91e0 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0.18d213ac-7c99-43cb-bc5e-e9785935f0fd {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-82ea48fc-c427-4fbc-937d-cd05c5add838 tempest-ProjectReaderTests-1170430630 None] Lock "cinder-da7a16db-a0c8-4d1b-b10f-595f8bac6fec-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:34 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46043042-b181-4b0b-9a74-079c170d91e0 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0.18d213ac-7c99-43cb-bc5e-e9785935f0fd Sep 01 02:18:34 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-82ea48fc-c427-4fbc-937d-cd05c5add838 tempest-ProjectReaderTests-1170430630 None] Acquiring lock "cinder-quobyte-da7a16db-a0c8-4d1b-b10f-595f8bac6fec" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-82ea48fc-c427-4fbc-937d-cd05c5add838 tempest-ProjectReaderTests-1170430630 None] Lock "cinder-quobyte-da7a16db-a0c8-4d1b-b10f-595f8bac6fec" acquired by "delete_volume" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[151a04e7-0659-4d53-82a8-96ab12d52445]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-82ea48fc-c427-4fbc-937d-cd05c5add838 tempest-ProjectReaderTests-1170430630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-da7a16db-a0c8-4d1b-b10f-595f8bac6fec {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:35 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-85a86203-4b13-4892-a49a-e4befc78c7c9 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73.c4394f3d-ad7b-48d0-9a2f-9c7f2aa5e047" returned: 0 in 0.489s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-85a86203-4b13-4892-a49a-e4befc78c7c9 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73.c4394f3d-ad7b-48d0-9a2f-9c7f2aa5e047 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:35 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73.c4394f3d-ad7b-48d0-9a2f-9c7f2aa5e047 Sep 01 02:18:35 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:35 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-da7a16db-a0c8-4d1b-b10f-595f8bac6fec Sep 01 02:18:35 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:35 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-89e9603e-2aa5-4328-816f-30eab5fd2b71 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46043042-b181-4b0b-9a74-079c170d91e0 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0.18d213ac-7c99-43cb-bc5e-e9785935f0fd" returned: 0 in 0.333s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:35 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-89e9603e-2aa5-4328-816f-30eab5fd2b71 tempest-ProjectMemberTests-1927748625 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0.18d213ac-7c99-43cb-bc5e-e9785935f0fd is being set with open permissions: ugo+rw Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-89e9603e-2aa5-4328-816f-30eab5fd2b71 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0.18d213ac-7c99-43cb-bc5e-e9785935f0fd {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:35 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0.18d213ac-7c99-43cb-bc5e-e9785935f0fd Sep 01 02:18:35 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:35 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-85a86203-4b13-4892-a49a-e4befc78c7c9 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73.c4394f3d-ad7b-48d0-9a2f-9c7f2aa5e047" returned: 0 in 0.277s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-85a86203-4b13-4892-a49a-e4befc78c7c9 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-quobyte-c4394f3d-ad7b-48d0-9a2f-9c7f2aa5e047" released by "_delete_snapshot" :: held 1.807s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-85a86203-4b13-4892-a49a-e4befc78c7c9 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-quobyte-2b413835-d98d-411c-b465-f163878a8f73" released by "delete_snapshot" :: held 1.834s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-85a86203-4b13-4892-a49a-e4befc78c7c9 tempest-ProjectReaderTests-1438211366 None] Created reservations ['44b0d1e9-7292-48a8-8d53-e14e3f2f00c4', '0c7f00fa-f8e1-445d-acfa-82f363f6a0d6', '59f8517d-a7d1-4b42-9157-50613cbb7737', 'e38f5843-2aaa-41cf-a51c-518d0fd4fa28'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:35 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-82ea48fc-c427-4fbc-937d-cd05c5add838 tempest-ProjectReaderTests-1170430630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-da7a16db-a0c8-4d1b-b10f-595f8bac6fec" returned: 0 in 0.431s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-82ea48fc-c427-4fbc-937d-cd05c5add838 tempest-ProjectReaderTests-1170430630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-da7a16db-a0c8-4d1b-b10f-595f8bac6fec {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:35 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-da7a16db-a0c8-4d1b-b10f-595f8bac6fec Sep 01 02:18:35 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:35 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-89e9603e-2aa5-4328-816f-30eab5fd2b71 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0.18d213ac-7c99-43cb-bc5e-e9785935f0fd" returned: 0 in 0.261s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-89e9603e-2aa5-4328-816f-30eab5fd2b71 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:35 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-85a86203-4b13-4892-a49a-e4befc78c7c9 tempest-ProjectReaderTests-1438211366 None] Delete snapshot completed successfully. Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-85a86203-4b13-4892-a49a-e4befc78c7c9 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-c4394f3d-ad7b-48d0-9a2f-9c7f2aa5e047-delete_snapshot" released by "delete_snapshot" :: held 2.033s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:35 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0.info Sep 01 02:18:35 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5b12038a-3e98-4faf-93db-908a5cc019ac tempest-ProjectReaderTests-1438211366 None] Acquiring lock "cinder-2b413835-d98d-411c-b465-f163878a8f73-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5b12038a-3e98-4faf-93db-908a5cc019ac tempest-ProjectReaderTests-1438211366 None] Lock "cinder-2b413835-d98d-411c-b465-f163878a8f73-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:35 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-82ea48fc-c427-4fbc-937d-cd05c5add838 tempest-ProjectReaderTests-1170430630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-da7a16db-a0c8-4d1b-b10f-595f8bac6fec" returned: 0 in 0.271s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-82ea48fc-c427-4fbc-937d-cd05c5add838 tempest-ProjectReaderTests-1170430630 None] Lock "cinder-quobyte-da7a16db-a0c8-4d1b-b10f-595f8bac6fec" released by "delete_volume" :: held 0.759s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5b12038a-3e98-4faf-93db-908a5cc019ac tempest-ProjectReaderTests-1438211366 None] Acquiring lock "cinder-quobyte-2b413835-d98d-411c-b465-f163878a8f73" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5b12038a-3e98-4faf-93db-908a5cc019ac tempest-ProjectReaderTests-1438211366 None] Lock "cinder-quobyte-2b413835-d98d-411c-b465-f163878a8f73" acquired by "delete_volume" :: waited 0.026s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:35 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-89e9603e-2aa5-4328-816f-30eab5fd2b71 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0.info" returned: 0 in 0.301s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:35 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-89e9603e-2aa5-4328-816f-30eab5fd2b71 tempest-ProjectMemberTests-1927748625 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0.info is being set with open permissions: ugo+rw Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-89e9603e-2aa5-4328-816f-30eab5fd2b71 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50be4a9-afc5-4536-a08b-97dfb2a68736]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5b12038a-3e98-4faf-93db-908a5cc019ac tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:35 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0.info Sep 01 02:18:35 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-82ea48fc-c427-4fbc-937d-cd05c5add838 tempest-ProjectReaderTests-1170430630 None] Created reservations ['e0e01023-0bc9-4660-8016-0ff06dee7494', '574d6e5e-037d-4abe-876b-3b22b63f1b50', 'd202dee4-643e-489d-bc4b-2a3b4190cd1f', '0068481f-0aac-4ebf-9b6b-f112ab86b389'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-82ea48fc-c427-4fbc-937d-cd05c5add838 tempest-ProjectReaderTests-1170430630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-82ea48fc-c427-4fbc-937d-cd05c5add838 tempest-ProjectReaderTests-1170430630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-82ea48fc-c427-4fbc-937d-cd05c5add838 tempest-ProjectReaderTests-1170430630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-82ea48fc-c427-4fbc-937d-cd05c5add838 tempest-ProjectReaderTests-1170430630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-82ea48fc-c427-4fbc-937d-cd05c5add838 tempest-ProjectReaderTests-1170430630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-82ea48fc-c427-4fbc-937d-cd05c5add838 tempest-ProjectReaderTests-1170430630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:35 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73 Sep 01 02:18:35 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:35 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:18:35 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:36 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-89e9603e-2aa5-4328-816f-30eab5fd2b71 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0.info" returned: 0 in 0.261s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-89e9603e-2aa5-4328-816f-30eab5fd2b71 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.324s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:36 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-89e9603e-2aa5-4328-816f-30eab5fd2b71 tempest-ProjectMemberTests-1927748625 None] Create snapshot completed successfully Sep 01 02:18:36 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5b12038a-3e98-4faf-93db-908a5cc019ac tempest-ProjectReaderTests-1438211366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73" returned: 0 in 0.389s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5b12038a-3e98-4faf-93db-908a5cc019ac tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:36 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-82ea48fc-c427-4fbc-937d-cd05c5add838 tempest-ProjectReaderTests-1170430630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.303s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-82ea48fc-c427-4fbc-937d-cd05c5add838 tempest-ProjectReaderTests-1170430630 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:36 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-82ea48fc-c427-4fbc-937d-cd05c5add838 tempest-ProjectReaderTests-1170430630 None] Deleted volume successfully. Sep 01 02:18:36 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73 Sep 01 02:18:36 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-82ea48fc-c427-4fbc-937d-cd05c5add838 tempest-ProjectReaderTests-1170430630 None] Lock "cinder-da7a16db-a0c8-4d1b-b10f-595f8bac6fec-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:36 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5b12038a-3e98-4faf-93db-908a5cc019ac tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-2b413835-d98d-411c-b465-f163878a8f73" returned: 0 in 0.262s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5b12038a-3e98-4faf-93db-908a5cc019ac tempest-ProjectReaderTests-1438211366 None] Lock "cinder-quobyte-2b413835-d98d-411c-b465-f163878a8f73" released by "delete_volume" :: held 0.744s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] Flow 'volume_create_manager' (1664bc36-c335-4c30-afa7-687c7c11bf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a090acc-13f1-4c9b-89fe-bfabe5054277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-368a9365-f4f4-4340-b4d2-61ecbb05c54b tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-18d213ac-7c99-43cb-bc5e-e9785935f0fd-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a090acc-13f1-4c9b-89fe-bfabe5054277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-647285374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2a9e270-0c92-4b73-b553-79dc284f37ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='765676f79a2d46fe9f5b14dedca1adde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:37Z,use_quota=True,user_id='3a343ed7e68647ccac402b35be700886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1871ef7-6089-4d4c-b93f-3e429df810ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1871ef7-6089-4d4c-b93f-3e429df810ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c1e111-da1c-404e-a0d8-73175dd82f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c1e111-da1c-404e-a0d8-73175dd82f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2a9e270-0c92-4b73-b553-79dc284f37ec', 'volume_name': 'volume-e2a9e270-0c92-4b73-b553-79dc284f37ec', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d9f550-df05-4ba0-b826-a41840bb6dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d9f550-df05-4ba0-b826-a41840bb6dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e4380a3-35d2-4aa3-b192-c0a290c50b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:36 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] Volume e2a9e270-0c92-4b73-b553-79dc284f37ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2a9e270-0c92-4b73-b553-79dc284f37ec', 'volume_size': 1} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-647285374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2a9e270-0c92-4b73-b553-79dc284f37ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='765676f79a2d46fe9f5b14dedca1adde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:37Z,use_quota=True,user_id='3a343ed7e68647ccac402b35be700886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] Creating volume e2a9e270-0c92-4b73-b553-79dc284f37ec {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:36 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e2a9e270-0c92-4b73-b553-79dc284f37ec 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-368a9365-f4f4-4340-b4d2-61ecbb05c54b tempest-ProjectMemberTests-1927748625 None] Lock "cinder-18d213ac-7c99-43cb-bc5e-e9785935f0fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.083s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-368a9365-f4f4-4340-b4d2-61ecbb05c54b tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-quobyte-46043042-b181-4b0b-9a74-079c170d91e0" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:36 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e2a9e270-0c92-4b73-b553-79dc284f37ec 1073741824 Sep 01 02:18:36 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-368a9365-f4f4-4340-b4d2-61ecbb05c54b tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-46043042-b181-4b0b-9a74-079c170d91e0" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-368a9365-f4f4-4340-b4d2-61ecbb05c54b tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-quobyte-18d213ac-7c99-43cb-bc5e-e9785935f0fd" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-5b12038a-3e98-4faf-93db-908a5cc019ac tempest-ProjectReaderTests-1438211366 None] Created reservations ['7e439443-6683-448d-8494-0034d9f95ce2', '1dd1ca56-1485-4b7c-b1e6-70af219614a2', 'cfab2a58-3de6-4360-b925-be8cc88f8da7', '59c7be6f-5fee-4ce8-8e07-f8943034f6d7'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-368a9365-f4f4-4340-b4d2-61ecbb05c54b tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-18d213ac-7c99-43cb-bc5e-e9785935f0fd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-368a9365-f4f4-4340-b4d2-61ecbb05c54b tempest-ProjectMemberTests-1927748625 None] Deleting offline snapshot 18d213ac-7c99-43cb-bc5e-e9785935f0fd of volume 46043042-b181-4b0b-9a74-079c170d91e0 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-368a9365-f4f4-4340-b4d2-61ecbb05c54b tempest-ProjectMemberTests-1927748625 None] snapshot_file for this snap is: volume-46043042-b181-4b0b-9a74-079c170d91e0.18d213ac-7c99-43cb-bc5e-e9785935f0fd {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90a4072-c6c1-4d3a-8667-5273149153e9]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-368a9365-f4f4-4340-b4d2-61ecbb05c54b tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0.18d213ac-7c99-43cb-bc5e-e9785935f0fd {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5b12038a-3e98-4faf-93db-908a5cc019ac tempest-ProjectReaderTests-1438211366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5b12038a-3e98-4faf-93db-908a5cc019ac tempest-ProjectReaderTests-1438211366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5b12038a-3e98-4faf-93db-908a5cc019ac tempest-ProjectReaderTests-1438211366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-5b12038a-3e98-4faf-93db-908a5cc019ac tempest-ProjectReaderTests-1438211366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-5b12038a-3e98-4faf-93db-908a5cc019ac tempest-ProjectReaderTests-1438211366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5b12038a-3e98-4faf-93db-908a5cc019ac tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:36 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:18:36 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:36 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0.18d213ac-7c99-43cb-bc5e-e9785935f0fd Sep 01 02:18:36 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:37 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5b12038a-3e98-4faf-93db-908a5cc019ac tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.270s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-5b12038a-3e98-4faf-93db-908a5cc019ac tempest-ProjectReaderTests-1438211366 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:37 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-5b12038a-3e98-4faf-93db-908a5cc019ac tempest-ProjectReaderTests-1438211366 None] Deleted volume successfully. Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5b12038a-3e98-4faf-93db-908a5cc019ac tempest-ProjectReaderTests-1438211366 None] Lock "cinder-2b413835-d98d-411c-b465-f163878a8f73-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:37 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e2a9e270-0c92-4b73-b553-79dc284f37ec 1073741824" returned: 0 in 0.556s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:37 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-368a9365-f4f4-4340-b4d2-61ecbb05c54b tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0.18d213ac-7c99-43cb-bc5e-e9785935f0fd" returned: 0 in 0.487s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-368a9365-f4f4-4340-b4d2-61ecbb05c54b tempest-ProjectMemberTests-1927748625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46043042-b181-4b0b-9a74-079c170d91e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d5efab-c8f2-403e-a43c-2fdf99eacc93]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-368a9365-f4f4-4340-b4d2-61ecbb05c54b tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e2a9e270-0c92-4b73-b553-79dc284f37ec {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:37 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e2a9e270-0c92-4b73-b553-79dc284f37ec Sep 01 02:18:37 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:37 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0 Sep 01 02:18:37 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] Flow 'volume_create_manager' (02d0ce2d-7019-4e16-8d87-7430635c47c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (415fa90c-7e20-4c4f-a1e4-440894cc9ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (415fa90c-7e20-4c4f-a1e4-440894cc9ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1972834366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db621d51-47c6-413e-9a04-1a6f5bdfd856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d058dbf4e44e93bebda8c4e31386c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:37Z,use_quota=True,user_id='b9d99efedc644ff2a9d2817061a6b9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21da4b23-cd17-42fb-a7d2-b9e4e2d647b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21da4b23-cd17-42fb-a7d2-b9e4e2d647b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6167830-f55c-4ea4-b7e0-9801a40ea25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6167830-f55c-4ea4-b7e0-9801a40ea25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db621d51-47c6-413e-9a04-1a6f5bdfd856', 'volume_name': 'volume-db621d51-47c6-413e-9a04-1a6f5bdfd856', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eec917f-c070-4f4e-a7dc-553b21be9e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eec917f-c070-4f4e-a7dc-553b21be9e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ec6ed0c-13e3-43cf-a04d-4b2a174b6b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:37 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] Volume db621d51-47c6-413e-9a04-1a6f5bdfd856: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db621d51-47c6-413e-9a04-1a6f5bdfd856', 'volume_size': 1} Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:37 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e2a9e270-0c92-4b73-b553-79dc284f37ec" returned: 0 in 0.262s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.023s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1972834366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db621d51-47c6-413e-9a04-1a6f5bdfd856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d058dbf4e44e93bebda8c4e31386c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:37Z,use_quota=True,user_id='b9d99efedc644ff2a9d2817061a6b9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] Creating volume db621d51-47c6-413e-9a04-1a6f5bdfd856 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:37 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:37 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856 1073741824 Sep 01 02:18:37 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e4380a3-35d2-4aa3-b192-c0a290c50b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2a9e270-0c92-4b73-b553-79dc284f37ec', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b5b643-552b-4f6a-a406-6c9fb61df42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:37 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] Volume volume-e2a9e270-0c92-4b73-b553-79dc284f37ec (e2a9e270-0c92-4b73-b553-79dc284f37ec): created successfully Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b5b643-552b-4f6a-a406-6c9fb61df42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] Flow 'volume_create_manager' (1664bc36-c335-4c30-afa7-687c7c11bf7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:37 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-b96b0f19-4ba4-4a73-b6b9-59ef09866bbf tempest-ProjectReaderTests-1170430630 None] Created volume successfully. Sep 01 02:18:37 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-368a9365-f4f4-4340-b4d2-61ecbb05c54b tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0" returned: 0 in 0.405s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-368a9365-f4f4-4340-b4d2-61ecbb05c54b tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0.18d213ac-7c99-43cb-bc5e-e9785935f0fd {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:37 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0.18d213ac-7c99-43cb-bc5e-e9785935f0fd Sep 01 02:18:37 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:38 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856 1073741824" returned: 0 in 0.467s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:38 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-368a9365-f4f4-4340-b4d2-61ecbb05c54b tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0.18d213ac-7c99-43cb-bc5e-e9785935f0fd" returned: 0 in 0.360s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-368a9365-f4f4-4340-b4d2-61ecbb05c54b tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0.18d213ac-7c99-43cb-bc5e-e9785935f0fd {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:38 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0.18d213ac-7c99-43cb-bc5e-e9785935f0fd Sep 01 02:18:38 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:38 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856 Sep 01 02:18:38 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:38 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-368a9365-f4f4-4340-b4d2-61ecbb05c54b tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0.18d213ac-7c99-43cb-bc5e-e9785935f0fd" returned: 0 in 0.246s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:38 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-368a9365-f4f4-4340-b4d2-61ecbb05c54b tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-18d213ac-7c99-43cb-bc5e-e9785935f0fd" released by "_delete_snapshot" :: held 1.619s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:38 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-368a9365-f4f4-4340-b4d2-61ecbb05c54b tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-46043042-b181-4b0b-9a74-079c170d91e0" released by "delete_snapshot" :: held 1.644s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:38 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856" returned: 0 in 0.284s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:38 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ec6ed0c-13e3-43cf-a04d-4b2a174b6b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db621d51-47c6-413e-9a04-1a6f5bdfd856', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86cb52c2-9040-4160-844b-f8a5aa78ab3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:38 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] Volume volume-db621d51-47c6-413e-9a04-1a6f5bdfd856 (db621d51-47c6-413e-9a04-1a6f5bdfd856): created successfully Sep 01 02:18:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86cb52c2-9040-4160-844b-f8a5aa78ab3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:38 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] Flow 'volume_create_manager' (02d0ce2d-7019-4e16-8d87-7430635c47c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:38 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-e0be8909-99ec-4561-944d-db2dd962afe2 tempest-ProjectReaderTests-1438211366 None] Created volume successfully. Sep 01 02:18:38 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-368a9365-f4f4-4340-b4d2-61ecbb05c54b tempest-ProjectMemberTests-1927748625 None] Created reservations ['55cd243c-eb1d-4547-b787-00c7733dc293', '095ddb8c-e770-427a-9f1b-2bdd001e2d0e', '9e3fe146-ab50-4e6e-b1fc-0f7aa46fc7d3', '2f57de65-57bd-4085-bf0f-bd6ba5a43156'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:38 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-368a9365-f4f4-4340-b4d2-61ecbb05c54b tempest-ProjectMemberTests-1927748625 None] Delete snapshot completed successfully. Sep 01 02:18:38 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-368a9365-f4f4-4340-b4d2-61ecbb05c54b tempest-ProjectMemberTests-1927748625 None] Lock "cinder-18d213ac-7c99-43cb-bc5e-e9785935f0fd-delete_snapshot" released by "delete_snapshot" :: held 1.852s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:38 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c7f509f9-4b28-48f4-95e2-76624e95872f tempest-ProjectReaderTests-1170430630 None] Acquiring lock "cinder-e2a9e270-0c92-4b73-b553-79dc284f37ec-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:38 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c7f509f9-4b28-48f4-95e2-76624e95872f tempest-ProjectReaderTests-1170430630 None] Lock "cinder-e2a9e270-0c92-4b73-b553-79dc284f37ec-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:38 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c7f509f9-4b28-48f4-95e2-76624e95872f tempest-ProjectReaderTests-1170430630 None] Acquiring lock "cinder-quobyte-e2a9e270-0c92-4b73-b553-79dc284f37ec" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:38 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c7f509f9-4b28-48f4-95e2-76624e95872f tempest-ProjectReaderTests-1170430630 None] Lock "cinder-quobyte-e2a9e270-0c92-4b73-b553-79dc284f37ec" acquired by "delete_volume" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:38 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab041ec-8d95-400b-bce6-f29cc371f91a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c7f509f9-4b28-48f4-95e2-76624e95872f tempest-ProjectReaderTests-1170430630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e2a9e270-0c92-4b73-b553-79dc284f37ec {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:38 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-855a53f5-f54a-43ed-b444-ce98f70574e7 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-46043042-b181-4b0b-9a74-079c170d91e0-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:38 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-855a53f5-f54a-43ed-b444-ce98f70574e7 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-46043042-b181-4b0b-9a74-079c170d91e0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:38 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-855a53f5-f54a-43ed-b444-ce98f70574e7 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-quobyte-46043042-b181-4b0b-9a74-079c170d91e0" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:38 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e2a9e270-0c92-4b73-b553-79dc284f37ec Sep 01 02:18:38 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:38 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-855a53f5-f54a-43ed-b444-ce98f70574e7 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-46043042-b181-4b0b-9a74-079c170d91e0" acquired by "delete_volume" :: waited 0.018s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:38 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66e4822-536f-458f-8c2a-f4699df3348a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:38 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-855a53f5-f54a-43ed-b444-ce98f70574e7 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:39 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0 Sep 01 02:18:39 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:39 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c7f509f9-4b28-48f4-95e2-76624e95872f tempest-ProjectReaderTests-1170430630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e2a9e270-0c92-4b73-b553-79dc284f37ec" returned: 0 in 0.393s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c7f509f9-4b28-48f4-95e2-76624e95872f tempest-ProjectReaderTests-1170430630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e2a9e270-0c92-4b73-b553-79dc284f37ec {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:39 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e2a9e270-0c92-4b73-b553-79dc284f37ec Sep 01 02:18:39 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:39 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-855a53f5-f54a-43ed-b444-ce98f70574e7 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0" returned: 0 in 0.383s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-855a53f5-f54a-43ed-b444-ce98f70574e7 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:39 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0 Sep 01 02:18:39 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:39 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c7f509f9-4b28-48f4-95e2-76624e95872f tempest-ProjectReaderTests-1170430630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e2a9e270-0c92-4b73-b553-79dc284f37ec" returned: 0 in 0.243s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:39 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c7f509f9-4b28-48f4-95e2-76624e95872f tempest-ProjectReaderTests-1170430630 None] Lock "cinder-quobyte-e2a9e270-0c92-4b73-b553-79dc284f37ec" released by "delete_volume" :: held 0.680s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:39 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-c7f509f9-4b28-48f4-95e2-76624e95872f tempest-ProjectReaderTests-1170430630 None] Created reservations ['bd74972e-10fb-48dd-8e60-8074763c607d', '476879b3-307d-430d-b094-6d9fca719b21', 'd6faae4d-5bd1-40e6-9cba-d34ac488f202', 'bd852433-fcdd-4cb0-840b-22e058e5d00c'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c7f509f9-4b28-48f4-95e2-76624e95872f tempest-ProjectReaderTests-1170430630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c7f509f9-4b28-48f4-95e2-76624e95872f tempest-ProjectReaderTests-1170430630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:39 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c7f509f9-4b28-48f4-95e2-76624e95872f tempest-ProjectReaderTests-1170430630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:39 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-c7f509f9-4b28-48f4-95e2-76624e95872f tempest-ProjectReaderTests-1170430630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-c7f509f9-4b28-48f4-95e2-76624e95872f tempest-ProjectReaderTests-1170430630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c7f509f9-4b28-48f4-95e2-76624e95872f tempest-ProjectReaderTests-1170430630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:39 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:18:39 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:39 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-855a53f5-f54a-43ed-b444-ce98f70574e7 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-46043042-b181-4b0b-9a74-079c170d91e0" returned: 0 in 0.272s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:39 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-855a53f5-f54a-43ed-b444-ce98f70574e7 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-46043042-b181-4b0b-9a74-079c170d91e0" released by "delete_volume" :: held 0.719s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:39 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-855a53f5-f54a-43ed-b444-ce98f70574e7 tempest-ProjectMemberTests-1927748625 None] Created reservations ['3b41104a-b1b8-47ab-9565-86b710b41c98', '413e7e52-9ff0-4c41-9129-a8157ced3689', '6def31d1-deaa-4f56-b715-fbf249372156', '7e0e5bc5-5d8e-4f2d-a264-439847737c88'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-271a55c1-0a63-4546-883b-50759f2d3420 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-271a55c1-0a63-4546-883b-50759f2d3420 tempest-ProjectReaderTests-1438211366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:39 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-271a55c1-0a63-4546-883b-50759f2d3420 tempest-ProjectReaderTests-1438211366 None] Creating offline snapshot 51f7157b-621b-4a63-985e-6a3d0d658a43 of volume db621d51-47c6-413e-9a04-1a6f5bdfd856 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:18:39 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9dbfe4-acc2-4eb9-8459-3724c8252a3e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-271a55c1-0a63-4546-883b-50759f2d3420 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-855a53f5-f54a-43ed-b444-ce98f70574e7 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-855a53f5-f54a-43ed-b444-ce98f70574e7 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:39 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-855a53f5-f54a-43ed-b444-ce98f70574e7 tempest-ProjectMemberTests-1927748625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:39 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-855a53f5-f54a-43ed-b444-ce98f70574e7 tempest-ProjectMemberTests-1927748625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-855a53f5-f54a-43ed-b444-ce98f70574e7 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-855a53f5-f54a-43ed-b444-ce98f70574e7 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:39 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:39 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-c7f509f9-4b28-48f4-95e2-76624e95872f tempest-ProjectReaderTests-1170430630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.335s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:39 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-c7f509f9-4b28-48f4-95e2-76624e95872f tempest-ProjectReaderTests-1170430630 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:39 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:18:39 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:39 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-c7f509f9-4b28-48f4-95e2-76624e95872f tempest-ProjectReaderTests-1170430630 None] Deleted volume successfully. Sep 01 02:18:39 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-c7f509f9-4b28-48f4-95e2-76624e95872f tempest-ProjectReaderTests-1170430630 None] Lock "cinder-e2a9e270-0c92-4b73-b553-79dc284f37ec-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:39 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856 Sep 01 02:18:40 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:40 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-855a53f5-f54a-43ed-b444-ce98f70574e7 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.395s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:40 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-855a53f5-f54a-43ed-b444-ce98f70574e7 tempest-ProjectMemberTests-1927748625 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:40 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-855a53f5-f54a-43ed-b444-ce98f70574e7 tempest-ProjectMemberTests-1927748625 None] Deleted volume successfully. Sep 01 02:18:40 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-855a53f5-f54a-43ed-b444-ce98f70574e7 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-46043042-b181-4b0b-9a74-079c170d91e0-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:40 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-271a55c1-0a63-4546-883b-50759f2d3420 tempest-ProjectReaderTests-1438211366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856" returned: 0 in 0.489s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-271a55c1-0a63-4546-883b-50759f2d3420 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856.51f7157b-621b-4a63-985e-6a3d0d658a43 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:40 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856.51f7157b-621b-4a63-985e-6a3d0d658a43 1G Sep 01 02:18:40 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:40 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:40 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] Flow 'volume_create_manager' (2f083109-915e-42a0-b8bc-316d9aab5588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:40 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e1c76a-52d7-42a2-a3e3-d5f9173fd92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:40 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e1c76a-52d7-42a2-a3e3-d5f9173fd92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1050161367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cca45ed4-daf3-4e61-a72a-d9613741c9b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61578a8868584ca29ab081523d408c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:41Z,use_quota=True,user_id='f2911f91e5124a7ba8862f4b148bf6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:40 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc1f148-7f20-4800-ace2-de84db0a892a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:40 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc1f148-7f20-4800-ace2-de84db0a892a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:40 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62323ea-d60f-4bc4-bbc7-9d56edc7850b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:40 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62323ea-d60f-4bc4-bbc7-9d56edc7850b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cca45ed4-daf3-4e61-a72a-d9613741c9b0', 'volume_name': 'volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:40 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b838d1-6eae-4ca5-88e8-6f600e5ef673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:40 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b838d1-6eae-4ca5-88e8-6f600e5ef673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:40 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1ac5dba-93bd-4ab4-9e46-26800ed059a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:40 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] Volume cca45ed4-daf3-4e61-a72a-d9613741c9b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0', 'volume_size': 1} Sep 01 02:18:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:40 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-271a55c1-0a63-4546-883b-50759f2d3420 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856.51f7157b-621b-4a63-985e-6a3d0d658a43 1G" returned: 0 in 0.512s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:40 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-271a55c1-0a63-4546-883b-50759f2d3420 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db621d51-47c6-413e-9a04-1a6f5bdfd856 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856.51f7157b-621b-4a63-985e-6a3d0d658a43 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:40 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db621d51-47c6-413e-9a04-1a6f5bdfd856 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856.51f7157b-621b-4a63-985e-6a3d0d658a43 Sep 01 02:18:40 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:41 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-271a55c1-0a63-4546-883b-50759f2d3420 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db621d51-47c6-413e-9a04-1a6f5bdfd856 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856.51f7157b-621b-4a63-985e-6a3d0d658a43" returned: 0 in 0.328s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:41 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-271a55c1-0a63-4546-883b-50759f2d3420 tempest-ProjectReaderTests-1438211366 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856.51f7157b-621b-4a63-985e-6a3d0d658a43 is being set with open permissions: ugo+rw Sep 01 02:18:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-271a55c1-0a63-4546-883b-50759f2d3420 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856.51f7157b-621b-4a63-985e-6a3d0d658a43 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:41 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856.51f7157b-621b-4a63-985e-6a3d0d658a43 Sep 01 02:18:41 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:41 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-271a55c1-0a63-4546-883b-50759f2d3420 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856.51f7157b-621b-4a63-985e-6a3d0d658a43" returned: 0 in 0.293s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-271a55c1-0a63-4546-883b-50759f2d3420 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:41 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856.info Sep 01 02:18:41 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:41 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-271a55c1-0a63-4546-883b-50759f2d3420 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856.info" returned: 0 in 0.270s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:41 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-271a55c1-0a63-4546-883b-50759f2d3420 tempest-ProjectReaderTests-1438211366 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856.info is being set with open permissions: ugo+rw Sep 01 02:18:41 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-271a55c1-0a63-4546-883b-50759f2d3420 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:41 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856.info Sep 01 02:18:41 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:42 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-271a55c1-0a63-4546-883b-50759f2d3420 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856.info" returned: 0 in 0.257s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-271a55c1-0a63-4546-883b-50759f2d3420 tempest-ProjectReaderTests-1438211366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.266s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.347s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1050161367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cca45ed4-daf3-4e61-a72a-d9613741c9b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61578a8868584ca29ab081523d408c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:41Z,use_quota=True,user_id='f2911f91e5124a7ba8862f4b148bf6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] Creating volume cca45ed4-daf3-4e61-a72a-d9613741c9b0 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:42 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:18:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:42 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0 1073741824 Sep 01 02:18:42 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:42 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-271a55c1-0a63-4546-883b-50759f2d3420 tempest-ProjectReaderTests-1438211366 None] Create snapshot completed successfully Sep 01 02:18:42 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0 1073741824" returned: 0 in 0.435s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:42 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0 Sep 01 02:18:42 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:42 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0" returned: 0 in 0.246s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:42 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1ac5dba-93bd-4ab4-9e46-26800ed059a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6014fb2-0feb-4e4b-9de8-169860ad407e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:42 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] Volume volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0 (cca45ed4-daf3-4e61-a72a-d9613741c9b0): created successfully Sep 01 02:18:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6014fb2-0feb-4e4b-9de8-169860ad407e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:42 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] Flow 'volume_create_manager' (2f083109-915e-42a0-b8bc-316d9aab5588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:42 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-8e30c752-60b5-4bda-9923-d5c949ad18b9 tempest-ProjectMemberTests-1927748625 None] Created volume successfully. Sep 01 02:18:42 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-858bb7b7-7693-40c8-9796-f6f5c1e9d244 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "cinder-51f7157b-621b-4a63-985e-6a3d0d658a43-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:42 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-858bb7b7-7693-40c8-9796-f6f5c1e9d244 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-51f7157b-621b-4a63-985e-6a3d0d658a43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:42 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-858bb7b7-7693-40c8-9796-f6f5c1e9d244 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "cinder-quobyte-db621d51-47c6-413e-9a04-1a6f5bdfd856" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:42 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-858bb7b7-7693-40c8-9796-f6f5c1e9d244 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-quobyte-db621d51-47c6-413e-9a04-1a6f5bdfd856" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:42 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-858bb7b7-7693-40c8-9796-f6f5c1e9d244 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "cinder-quobyte-51f7157b-621b-4a63-985e-6a3d0d658a43" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:42 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-858bb7b7-7693-40c8-9796-f6f5c1e9d244 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-quobyte-51f7157b-621b-4a63-985e-6a3d0d658a43" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:42 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-858bb7b7-7693-40c8-9796-f6f5c1e9d244 tempest-ProjectReaderTests-1438211366 None] Deleting offline snapshot 51f7157b-621b-4a63-985e-6a3d0d658a43 of volume db621d51-47c6-413e-9a04-1a6f5bdfd856 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:18:43 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-858bb7b7-7693-40c8-9796-f6f5c1e9d244 tempest-ProjectReaderTests-1438211366 None] snapshot_file for this snap is: volume-db621d51-47c6-413e-9a04-1a6f5bdfd856.51f7157b-621b-4a63-985e-6a3d0d658a43 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:18:43 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[292e4704-bb05-41ce-a8d5-b0429b5bafe9]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-858bb7b7-7693-40c8-9796-f6f5c1e9d244 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856.51f7157b-621b-4a63-985e-6a3d0d658a43 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:43 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856.51f7157b-621b-4a63-985e-6a3d0d658a43 Sep 01 02:18:43 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:43 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-858bb7b7-7693-40c8-9796-f6f5c1e9d244 tempest-ProjectReaderTests-1438211366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856.51f7157b-621b-4a63-985e-6a3d0d658a43" returned: 0 in 0.344s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:43 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-858bb7b7-7693-40c8-9796-f6f5c1e9d244 tempest-ProjectReaderTests-1438211366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db621d51-47c6-413e-9a04-1a6f5bdfd856(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:18:43 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea04e34-9495-4262-b5e3-0e763f6ca516]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-858bb7b7-7693-40c8-9796-f6f5c1e9d244 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:43 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856 Sep 01 02:18:43 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:43 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-858bb7b7-7693-40c8-9796-f6f5c1e9d244 tempest-ProjectReaderTests-1438211366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856" returned: 0 in 0.362s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-858bb7b7-7693-40c8-9796-f6f5c1e9d244 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856.51f7157b-621b-4a63-985e-6a3d0d658a43 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:43 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856.51f7157b-621b-4a63-985e-6a3d0d658a43 Sep 01 02:18:43 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b6a88d6d-c04e-4c9d-8b8a-f5406647a4e9 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b6a88d6d-c04e-4c9d-8b8a-f5406647a4e9 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:43 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-b6a88d6d-c04e-4c9d-8b8a-f5406647a4e9 tempest-ProjectMemberTests-1927748625 None] Creating offline snapshot ea4d239d-6507-43d6-b0d8-1cafd4f2dbce of volume cca45ed4-daf3-4e61-a72a-d9613741c9b0 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:18:43 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[9379da88-f8f1-4a81-84f4-7190cbe2d622]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:43 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b6a88d6d-c04e-4c9d-8b8a-f5406647a4e9 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:43 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0 Sep 01 02:18:43 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:44 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-858bb7b7-7693-40c8-9796-f6f5c1e9d244 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856.51f7157b-621b-4a63-985e-6a3d0d658a43" returned: 0 in 0.360s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-858bb7b7-7693-40c8-9796-f6f5c1e9d244 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856.51f7157b-621b-4a63-985e-6a3d0d658a43 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:44 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856.51f7157b-621b-4a63-985e-6a3d0d658a43 Sep 01 02:18:44 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:44 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b6a88d6d-c04e-4c9d-8b8a-f5406647a4e9 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0" returned: 0 in 0.396s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b6a88d6d-c04e-4c9d-8b8a-f5406647a4e9 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0.ea4d239d-6507-43d6-b0d8-1cafd4f2dbce 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:44 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0.ea4d239d-6507-43d6-b0d8-1cafd4f2dbce 1G Sep 01 02:18:44 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:44 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-858bb7b7-7693-40c8-9796-f6f5c1e9d244 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856.51f7157b-621b-4a63-985e-6a3d0d658a43" returned: 0 in 0.240s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:44 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-858bb7b7-7693-40c8-9796-f6f5c1e9d244 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-quobyte-51f7157b-621b-4a63-985e-6a3d0d658a43" released by "_delete_snapshot" :: held 1.400s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:44 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-858bb7b7-7693-40c8-9796-f6f5c1e9d244 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-quobyte-db621d51-47c6-413e-9a04-1a6f5bdfd856" released by "delete_snapshot" :: held 1.423s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:44 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-858bb7b7-7693-40c8-9796-f6f5c1e9d244 tempest-ProjectReaderTests-1438211366 None] Created reservations ['a9f2400a-7b99-44d3-92bb-08a7dff3c995', 'f679eb1f-9747-4044-a97f-0ac74cacdf81', 'b9477dab-43a7-4aa2-bd79-16a82227b801', '96911ac7-bb31-46cd-9ee0-0bf531215496'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:44 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-858bb7b7-7693-40c8-9796-f6f5c1e9d244 tempest-ProjectReaderTests-1438211366 None] Delete snapshot completed successfully. Sep 01 02:18:44 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-858bb7b7-7693-40c8-9796-f6f5c1e9d244 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-51f7157b-621b-4a63-985e-6a3d0d658a43-delete_snapshot" released by "delete_snapshot" :: held 1.564s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:44 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b6a88d6d-c04e-4c9d-8b8a-f5406647a4e9 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0.ea4d239d-6507-43d6-b0d8-1cafd4f2dbce 1G" returned: 0 in 0.411s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b6a88d6d-c04e-4c9d-8b8a-f5406647a4e9 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0.ea4d239d-6507-43d6-b0d8-1cafd4f2dbce {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:44 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0.ea4d239d-6507-43d6-b0d8-1cafd4f2dbce Sep 01 02:18:44 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:44 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b6a88d6d-c04e-4c9d-8b8a-f5406647a4e9 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0.ea4d239d-6507-43d6-b0d8-1cafd4f2dbce" returned: 0 in 0.293s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:44 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-b6a88d6d-c04e-4c9d-8b8a-f5406647a4e9 tempest-ProjectMemberTests-1927748625 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0.ea4d239d-6507-43d6-b0d8-1cafd4f2dbce is being set with open permissions: ugo+rw Sep 01 02:18:44 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b6a88d6d-c04e-4c9d-8b8a-f5406647a4e9 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0.ea4d239d-6507-43d6-b0d8-1cafd4f2dbce {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:44 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0.ea4d239d-6507-43d6-b0d8-1cafd4f2dbce Sep 01 02:18:44 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:45 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0240538a-43b5-456f-81d6-c6987a0356fa tempest-ProjectReaderTests-1438211366 None] Acquiring lock "cinder-db621d51-47c6-413e-9a04-1a6f5bdfd856-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:45 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0240538a-43b5-456f-81d6-c6987a0356fa tempest-ProjectReaderTests-1438211366 None] Lock "cinder-db621d51-47c6-413e-9a04-1a6f5bdfd856-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:45 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0240538a-43b5-456f-81d6-c6987a0356fa tempest-ProjectReaderTests-1438211366 None] Acquiring lock "cinder-quobyte-db621d51-47c6-413e-9a04-1a6f5bdfd856" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:45 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0240538a-43b5-456f-81d6-c6987a0356fa tempest-ProjectReaderTests-1438211366 None] Lock "cinder-quobyte-db621d51-47c6-413e-9a04-1a6f5bdfd856" acquired by "delete_volume" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:45 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b6a88d6d-c04e-4c9d-8b8a-f5406647a4e9 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0.ea4d239d-6507-43d6-b0d8-1cafd4f2dbce" returned: 0 in 0.291s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:45 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b623737-b09f-4d51-a36e-c6f988d6659b]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0240538a-43b5-456f-81d6-c6987a0356fa tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b6a88d6d-c04e-4c9d-8b8a-f5406647a4e9 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:45 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0.info Sep 01 02:18:45 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:45 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856 Sep 01 02:18:45 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:45 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b6a88d6d-c04e-4c9d-8b8a-f5406647a4e9 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0.info" returned: 0 in 0.259s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:45 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-b6a88d6d-c04e-4c9d-8b8a-f5406647a4e9 tempest-ProjectMemberTests-1927748625 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0.info is being set with open permissions: ugo+rw Sep 01 02:18:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b6a88d6d-c04e-4c9d-8b8a-f5406647a4e9 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:45 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0.info Sep 01 02:18:45 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:45 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0240538a-43b5-456f-81d6-c6987a0356fa tempest-ProjectReaderTests-1438211366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856" returned: 0 in 0.358s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0240538a-43b5-456f-81d6-c6987a0356fa tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:45 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856 Sep 01 02:18:45 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:45 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b6a88d6d-c04e-4c9d-8b8a-f5406647a4e9 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0.info" returned: 0 in 0.243s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b6a88d6d-c04e-4c9d-8b8a-f5406647a4e9 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.982s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:45 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-b6a88d6d-c04e-4c9d-8b8a-f5406647a4e9 tempest-ProjectMemberTests-1927748625 None] Create snapshot completed successfully Sep 01 02:18:45 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:45 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0240538a-43b5-456f-81d6-c6987a0356fa tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-db621d51-47c6-413e-9a04-1a6f5bdfd856" returned: 0 in 0.253s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:45 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0240538a-43b5-456f-81d6-c6987a0356fa tempest-ProjectReaderTests-1438211366 None] Lock "cinder-quobyte-db621d51-47c6-413e-9a04-1a6f5bdfd856" released by "delete_volume" :: held 0.677s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:45 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-0240538a-43b5-456f-81d6-c6987a0356fa tempest-ProjectReaderTests-1438211366 None] Created reservations ['30d868a5-f600-47cb-9c75-186ca12b7956', 'a81c4948-23a4-4320-9f5f-11cb6f626b81', '446b1a86-2a74-479c-a271-e30673a1572d', '214b0829-e456-462a-b9cc-463ea753705b'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:45 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6f680ec1-1de9-4f9f-8016-00b958233c94 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-ea4d239d-6507-43d6-b0d8-1cafd4f2dbce-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:45 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6f680ec1-1de9-4f9f-8016-00b958233c94 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-ea4d239d-6507-43d6-b0d8-1cafd4f2dbce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:45 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6f680ec1-1de9-4f9f-8016-00b958233c94 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-quobyte-cca45ed4-daf3-4e61-a72a-d9613741c9b0" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:45 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6f680ec1-1de9-4f9f-8016-00b958233c94 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-cca45ed4-daf3-4e61-a72a-d9613741c9b0" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:45 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6f680ec1-1de9-4f9f-8016-00b958233c94 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-quobyte-ea4d239d-6507-43d6-b0d8-1cafd4f2dbce" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6f680ec1-1de9-4f9f-8016-00b958233c94 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-ea4d239d-6507-43d6-b0d8-1cafd4f2dbce" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-6f680ec1-1de9-4f9f-8016-00b958233c94 tempest-ProjectMemberTests-1927748625 None] Deleting offline snapshot ea4d239d-6507-43d6-b0d8-1cafd4f2dbce of volume cca45ed4-daf3-4e61-a72a-d9613741c9b0 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-6f680ec1-1de9-4f9f-8016-00b958233c94 tempest-ProjectMemberTests-1927748625 None] snapshot_file for this snap is: volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0.ea4d239d-6507-43d6-b0d8-1cafd4f2dbce {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c288b2-dda2-4bfc-8883-ab6010c66d48]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6f680ec1-1de9-4f9f-8016-00b958233c94 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0.ea4d239d-6507-43d6-b0d8-1cafd4f2dbce {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0240538a-43b5-456f-81d6-c6987a0356fa tempest-ProjectReaderTests-1438211366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0240538a-43b5-456f-81d6-c6987a0356fa tempest-ProjectReaderTests-1438211366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0240538a-43b5-456f-81d6-c6987a0356fa tempest-ProjectReaderTests-1438211366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-0240538a-43b5-456f-81d6-c6987a0356fa tempest-ProjectReaderTests-1438211366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-0240538a-43b5-456f-81d6-c6987a0356fa tempest-ProjectReaderTests-1438211366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0240538a-43b5-456f-81d6-c6987a0356fa tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:46 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:18:46 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:46 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0.ea4d239d-6507-43d6-b0d8-1cafd4f2dbce Sep 01 02:18:46 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:46 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-0240538a-43b5-456f-81d6-c6987a0356fa tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.241s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-0240538a-43b5-456f-81d6-c6987a0356fa tempest-ProjectReaderTests-1438211366 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:46 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-0240538a-43b5-456f-81d6-c6987a0356fa tempest-ProjectReaderTests-1438211366 None] Deleted volume successfully. Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-0240538a-43b5-456f-81d6-c6987a0356fa tempest-ProjectReaderTests-1438211366 None] Lock "cinder-db621d51-47c6-413e-9a04-1a6f5bdfd856-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:46 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6f680ec1-1de9-4f9f-8016-00b958233c94 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0.ea4d239d-6507-43d6-b0d8-1cafd4f2dbce" returned: 0 in 0.365s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-6f680ec1-1de9-4f9f-8016-00b958233c94 tempest-ProjectMemberTests-1927748625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0655a06-5c0e-4337-92e3-5cf395410ad0]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6f680ec1-1de9-4f9f-8016-00b958233c94 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:46 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0 Sep 01 02:18:46 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] Flow 'volume_create_manager' (7ef647ff-9d2b-44c0-b6e6-1525d1df8c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ba4af02-da70-4488-a53c-2b82d88ed0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:46 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ba4af02-da70-4488-a53c-2b82d88ed0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-827774696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=577a5f08-84da-4e7c-85dc-dab10f96ab24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d058dbf4e44e93bebda8c4e31386c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:47Z,use_quota=True,user_id='b9d99efedc644ff2a9d2817061a6b9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33477e5f-7b9a-4fec-8822-e84b078e7b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33477e5f-7b9a-4fec-8822-e84b078e7b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9c78b3-a976-4a9f-a5b3-d3346770ec22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9c78b3-a976-4a9f-a5b3-d3346770ec22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '577a5f08-84da-4e7c-85dc-dab10f96ab24', 'volume_name': 'volume-577a5f08-84da-4e7c-85dc-dab10f96ab24', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93a4981-dc02-480f-a84a-7f4b6690b03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93a4981-dc02-480f-a84a-7f4b6690b03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06bb16d2-41a8-489b-ac75-51e8245b8418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:46 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] Volume 577a5f08-84da-4e7c-85dc-dab10f96ab24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-577a5f08-84da-4e7c-85dc-dab10f96ab24', 'volume_size': 1} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-827774696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=577a5f08-84da-4e7c-85dc-dab10f96ab24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d058dbf4e44e93bebda8c4e31386c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:47Z,use_quota=True,user_id='b9d99efedc644ff2a9d2817061a6b9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] Creating volume 577a5f08-84da-4e7c-85dc-dab10f96ab24 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:46 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6f680ec1-1de9-4f9f-8016-00b958233c94 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0" returned: 0 in 0.436s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:46 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6f680ec1-1de9-4f9f-8016-00b958233c94 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0.ea4d239d-6507-43d6-b0d8-1cafd4f2dbce {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:46 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24 1073741824 Sep 01 02:18:46 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:46 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0.ea4d239d-6507-43d6-b0d8-1cafd4f2dbce Sep 01 02:18:46 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:47 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6f680ec1-1de9-4f9f-8016-00b958233c94 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0.ea4d239d-6507-43d6-b0d8-1cafd4f2dbce" returned: 0 in 0.345s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6f680ec1-1de9-4f9f-8016-00b958233c94 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0.ea4d239d-6507-43d6-b0d8-1cafd4f2dbce {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:47 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0.ea4d239d-6507-43d6-b0d8-1cafd4f2dbce Sep 01 02:18:47 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:47 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24 1073741824" returned: 0 in 0.408s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:47 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24 Sep 01 02:18:47 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:47 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6f680ec1-1de9-4f9f-8016-00b958233c94 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0.ea4d239d-6507-43d6-b0d8-1cafd4f2dbce" returned: 0 in 0.288s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:47 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6f680ec1-1de9-4f9f-8016-00b958233c94 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-ea4d239d-6507-43d6-b0d8-1cafd4f2dbce" released by "_delete_snapshot" :: held 1.535s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:47 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6f680ec1-1de9-4f9f-8016-00b958233c94 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-cca45ed4-daf3-4e61-a72a-d9613741c9b0" released by "delete_snapshot" :: held 1.563s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:47 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24" returned: 0 in 0.250s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:47 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06bb16d2-41a8-489b-ac75-51e8245b8418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-577a5f08-84da-4e7c-85dc-dab10f96ab24', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9eada89-27b8-42ff-9f75-77eed99b6fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:47 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] Volume volume-577a5f08-84da-4e7c-85dc-dab10f96ab24 (577a5f08-84da-4e7c-85dc-dab10f96ab24): created successfully Sep 01 02:18:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9eada89-27b8-42ff-9f75-77eed99b6fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:47 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] Flow 'volume_create_manager' (7ef647ff-9d2b-44c0-b6e6-1525d1df8c24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:47 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-fdaa54d0-3272-45b6-8641-17f346f144e1 tempest-ProjectReaderTests-1438211366 None] Created volume successfully. Sep 01 02:18:47 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-6f680ec1-1de9-4f9f-8016-00b958233c94 tempest-ProjectMemberTests-1927748625 None] Created reservations ['ae644f4e-6183-48c4-8882-3d71600603f0', 'a94deb77-84bb-4837-908c-df34352722eb', '7055d70e-4b71-4561-be9a-cf483bc3a67d', '79a72908-4958-49ac-bc66-955c444afe5b'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:47 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-6f680ec1-1de9-4f9f-8016-00b958233c94 tempest-ProjectMemberTests-1927748625 None] Delete snapshot completed successfully. Sep 01 02:18:47 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6f680ec1-1de9-4f9f-8016-00b958233c94 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-ea4d239d-6507-43d6-b0d8-1cafd4f2dbce-delete_snapshot" released by "delete_snapshot" :: held 1.747s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8c0aecd6-578f-40ec-9895-1060f88cdd5b tempest-ProjectReaderTests-1438211366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8c0aecd6-578f-40ec-9895-1060f88cdd5b tempest-ProjectReaderTests-1438211366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:47 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-8c0aecd6-578f-40ec-9895-1060f88cdd5b tempest-ProjectReaderTests-1438211366 None] Creating offline snapshot 7f6ccf4d-5583-443b-84e7-a8ef66d32bf1 of volume 577a5f08-84da-4e7c-85dc-dab10f96ab24 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:18:47 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb900cc0-b5ba-4661-8d02-84e686924fe4]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:47 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8c0aecd6-578f-40ec-9895-1060f88cdd5b tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:48 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24 Sep 01 02:18:48 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:48 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-a007930f-145c-4824-b8ca-61563fcf1b25 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-cca45ed4-daf3-4e61-a72a-d9613741c9b0-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:48 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-a007930f-145c-4824-b8ca-61563fcf1b25 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-cca45ed4-daf3-4e61-a72a-d9613741c9b0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:48 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-a007930f-145c-4824-b8ca-61563fcf1b25 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-quobyte-cca45ed4-daf3-4e61-a72a-d9613741c9b0" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:48 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-a007930f-145c-4824-b8ca-61563fcf1b25 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-cca45ed4-daf3-4e61-a72a-d9613741c9b0" acquired by "delete_volume" :: waited 0.019s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:48 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a94e43-740d-4f11-8111-f35a58947685]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a007930f-145c-4824-b8ca-61563fcf1b25 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:48 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8c0aecd6-578f-40ec-9895-1060f88cdd5b tempest-ProjectReaderTests-1438211366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24" returned: 0 in 0.379s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8c0aecd6-578f-40ec-9895-1060f88cdd5b tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24.7f6ccf4d-5583-443b-84e7-a8ef66d32bf1 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:48 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0 Sep 01 02:18:48 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:48 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24.7f6ccf4d-5583-443b-84e7-a8ef66d32bf1 1G Sep 01 02:18:48 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:48 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a007930f-145c-4824-b8ca-61563fcf1b25 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0" returned: 0 in 0.361s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a007930f-145c-4824-b8ca-61563fcf1b25 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:48 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0 Sep 01 02:18:48 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:48 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8c0aecd6-578f-40ec-9895-1060f88cdd5b tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24.7f6ccf4d-5583-443b-84e7-a8ef66d32bf1 1G" returned: 0 in 0.420s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8c0aecd6-578f-40ec-9895-1060f88cdd5b tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-577a5f08-84da-4e7c-85dc-dab10f96ab24 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24.7f6ccf4d-5583-443b-84e7-a8ef66d32bf1 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:48 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-577a5f08-84da-4e7c-85dc-dab10f96ab24 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24.7f6ccf4d-5583-443b-84e7-a8ef66d32bf1 Sep 01 02:18:48 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:48 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a007930f-145c-4824-b8ca-61563fcf1b25 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-cca45ed4-daf3-4e61-a72a-d9613741c9b0" returned: 0 in 0.261s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:48 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-a007930f-145c-4824-b8ca-61563fcf1b25 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-cca45ed4-daf3-4e61-a72a-d9613741c9b0" released by "delete_volume" :: held 0.679s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:48 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-a007930f-145c-4824-b8ca-61563fcf1b25 tempest-ProjectMemberTests-1927748625 None] Created reservations ['377b5e23-466d-47cf-b693-b605b651ff72', '84367638-0f1e-4b46-9d8f-e11d5a661768', 'db8a3955-73a9-4def-89ec-7dd69de93ed6', 'a8226a71-c62a-40e5-8ee5-2bf4e130705f'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a007930f-145c-4824-b8ca-61563fcf1b25 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a007930f-145c-4824-b8ca-61563fcf1b25 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:48 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a007930f-145c-4824-b8ca-61563fcf1b25 tempest-ProjectMemberTests-1927748625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:48 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a007930f-145c-4824-b8ca-61563fcf1b25 tempest-ProjectMemberTests-1927748625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a007930f-145c-4824-b8ca-61563fcf1b25 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:48 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a007930f-145c-4824-b8ca-61563fcf1b25 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:49 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:18:49 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:49 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8c0aecd6-578f-40ec-9895-1060f88cdd5b tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-577a5f08-84da-4e7c-85dc-dab10f96ab24 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24.7f6ccf4d-5583-443b-84e7-a8ef66d32bf1" returned: 0 in 0.326s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:49 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-8c0aecd6-578f-40ec-9895-1060f88cdd5b tempest-ProjectReaderTests-1438211366 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24.7f6ccf4d-5583-443b-84e7-a8ef66d32bf1 is being set with open permissions: ugo+rw Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8c0aecd6-578f-40ec-9895-1060f88cdd5b tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24.7f6ccf4d-5583-443b-84e7-a8ef66d32bf1 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:49 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24.7f6ccf4d-5583-443b-84e7-a8ef66d32bf1 Sep 01 02:18:49 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:49 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a007930f-145c-4824-b8ca-61563fcf1b25 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.257s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-a007930f-145c-4824-b8ca-61563fcf1b25 tempest-ProjectMemberTests-1927748625 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:49 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-a007930f-145c-4824-b8ca-61563fcf1b25 tempest-ProjectMemberTests-1927748625 None] Deleted volume successfully. Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-a007930f-145c-4824-b8ca-61563fcf1b25 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-cca45ed4-daf3-4e61-a72a-d9613741c9b0-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:49 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8c0aecd6-578f-40ec-9895-1060f88cdd5b tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24.7f6ccf4d-5583-443b-84e7-a8ef66d32bf1" returned: 0 in 0.258s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8c0aecd6-578f-40ec-9895-1060f88cdd5b tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:49 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24.info Sep 01 02:18:49 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:49 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8c0aecd6-578f-40ec-9895-1060f88cdd5b tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24.info" returned: 0 in 0.269s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:49 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-8c0aecd6-578f-40ec-9895-1060f88cdd5b tempest-ProjectReaderTests-1438211366 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24.info is being set with open permissions: ugo+rw Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8c0aecd6-578f-40ec-9895-1060f88cdd5b tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:49 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24.info Sep 01 02:18:49 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] Flow 'volume_create_manager' (ab9959e9-179a-4c81-822c-57f6614af305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fde95a-ad8c-4199-aa38-5e886b5a79f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fde95a-ad8c-4199-aa38-5e886b5a79f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1637780715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e09812b0-65c8-46e3-99df-abc2b9f03d4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61578a8868584ca29ab081523d408c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:50Z,use_quota=True,user_id='f2911f91e5124a7ba8862f4b148bf6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d40a4a-3d01-42cf-928c-e2d5c6b8b01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d40a4a-3d01-42cf-928c-e2d5c6b8b01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (953ea018-8b21-48b0-bb86-9d7fdc41bbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (953ea018-8b21-48b0-bb86-9d7fdc41bbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e09812b0-65c8-46e3-99df-abc2b9f03d4b', 'volume_name': 'volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e616762-41ce-4a37-ac0a-598523b75bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e616762-41ce-4a37-ac0a-598523b75bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6494872-5641-4a95-ad73-59bb7a29a88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:49 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] Volume e09812b0-65c8-46e3-99df-abc2b9f03d4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b', 'volume_size': 1} Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:49 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8c0aecd6-578f-40ec-9895-1060f88cdd5b tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24.info" returned: 0 in 0.248s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8c0aecd6-578f-40ec-9895-1060f88cdd5b tempest-ProjectReaderTests-1438211366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.970s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.049s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1637780715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e09812b0-65c8-46e3-99df-abc2b9f03d4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61578a8868584ca29ab081523d408c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:50Z,use_quota=True,user_id='f2911f91e5124a7ba8862f4b148bf6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] Creating volume e09812b0-65c8-46e3-99df-abc2b9f03d4b {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:49 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:18:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:49 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b 1073741824 Sep 01 02:18:49 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:49 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-8c0aecd6-578f-40ec-9895-1060f88cdd5b tempest-ProjectReaderTests-1438211366 None] Create snapshot completed successfully Sep 01 02:18:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-eba80672-7806-448d-a5e1-8c1e843eef33 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "cinder-7f6ccf4d-5583-443b-84e7-a8ef66d32bf1-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-eba80672-7806-448d-a5e1-8c1e843eef33 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-7f6ccf4d-5583-443b-84e7-a8ef66d32bf1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-eba80672-7806-448d-a5e1-8c1e843eef33 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "cinder-quobyte-577a5f08-84da-4e7c-85dc-dab10f96ab24" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-eba80672-7806-448d-a5e1-8c1e843eef33 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-quobyte-577a5f08-84da-4e7c-85dc-dab10f96ab24" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-eba80672-7806-448d-a5e1-8c1e843eef33 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "cinder-quobyte-7f6ccf4d-5583-443b-84e7-a8ef66d32bf1" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-eba80672-7806-448d-a5e1-8c1e843eef33 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-quobyte-7f6ccf4d-5583-443b-84e7-a8ef66d32bf1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:50 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-eba80672-7806-448d-a5e1-8c1e843eef33 tempest-ProjectReaderTests-1438211366 None] Deleting offline snapshot 7f6ccf4d-5583-443b-84e7-a8ef66d32bf1 of volume 577a5f08-84da-4e7c-85dc-dab10f96ab24 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:18:50 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-eba80672-7806-448d-a5e1-8c1e843eef33 tempest-ProjectReaderTests-1438211366 None] snapshot_file for this snap is: volume-577a5f08-84da-4e7c-85dc-dab10f96ab24.7f6ccf4d-5583-443b-84e7-a8ef66d32bf1 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:18:50 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc552a8-0717-4eec-9393-efc9c376b322]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eba80672-7806-448d-a5e1-8c1e843eef33 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24.7f6ccf4d-5583-443b-84e7-a8ef66d32bf1 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:50 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24.7f6ccf4d-5583-443b-84e7-a8ef66d32bf1 Sep 01 02:18:50 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:50 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b 1073741824" returned: 0 in 0.418s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:50 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b Sep 01 02:18:50 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:50 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eba80672-7806-448d-a5e1-8c1e843eef33 tempest-ProjectReaderTests-1438211366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24.7f6ccf4d-5583-443b-84e7-a8ef66d32bf1" returned: 0 in 0.371s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:50 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-eba80672-7806-448d-a5e1-8c1e843eef33 tempest-ProjectReaderTests-1438211366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-577a5f08-84da-4e7c-85dc-dab10f96ab24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:18:50 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[91816464-ef70-4232-94bc-f8981aec652d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eba80672-7806-448d-a5e1-8c1e843eef33 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:50 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b" returned: 0 in 0.267s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:50 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:50 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6494872-5641-4a95-ad73-59bb7a29a88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:50 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a7232f-4451-4c05-9d59-6ef0e10919d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:50 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24 Sep 01 02:18:50 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:50 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] Volume volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b (e09812b0-65c8-46e3-99df-abc2b9f03d4b): created successfully Sep 01 02:18:50 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a7232f-4451-4c05-9d59-6ef0e10919d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:50 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] Flow 'volume_create_manager' (ab9959e9-179a-4c81-822c-57f6614af305) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:50 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-6fc390e1-df91-46d4-8f8c-ca36b056f164 tempest-ProjectMemberTests-1927748625 None] Created volume successfully. Sep 01 02:18:50 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eba80672-7806-448d-a5e1-8c1e843eef33 tempest-ProjectReaderTests-1438211366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24" returned: 0 in 0.362s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eba80672-7806-448d-a5e1-8c1e843eef33 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24.7f6ccf4d-5583-443b-84e7-a8ef66d32bf1 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:50 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24.7f6ccf4d-5583-443b-84e7-a8ef66d32bf1 Sep 01 02:18:50 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:51 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eba80672-7806-448d-a5e1-8c1e843eef33 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24.7f6ccf4d-5583-443b-84e7-a8ef66d32bf1" returned: 0 in 0.321s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eba80672-7806-448d-a5e1-8c1e843eef33 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24.7f6ccf4d-5583-443b-84e7-a8ef66d32bf1 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:51 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24.7f6ccf4d-5583-443b-84e7-a8ef66d32bf1 Sep 01 02:18:51 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:51 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-eba80672-7806-448d-a5e1-8c1e843eef33 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24.7f6ccf4d-5583-443b-84e7-a8ef66d32bf1" returned: 0 in 0.235s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-eba80672-7806-448d-a5e1-8c1e843eef33 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-quobyte-7f6ccf4d-5583-443b-84e7-a8ef66d32bf1" released by "_delete_snapshot" :: held 1.372s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-eba80672-7806-448d-a5e1-8c1e843eef33 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-quobyte-577a5f08-84da-4e7c-85dc-dab10f96ab24" released by "delete_snapshot" :: held 1.400s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:51 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-eba80672-7806-448d-a5e1-8c1e843eef33 tempest-ProjectReaderTests-1438211366 None] Created reservations ['2487f0b3-0291-4ca5-8c8f-27aedef3c394', '21cf686c-1c74-480a-89e9-16a350cb4977', 'f04257ee-99ad-47d0-9336-661f5fd5ae47', '2be95aa2-af90-4f3c-856d-d94ae9326217'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:51 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-eba80672-7806-448d-a5e1-8c1e843eef33 tempest-ProjectReaderTests-1438211366 None] Delete snapshot completed successfully. Sep 01 02:18:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-eba80672-7806-448d-a5e1-8c1e843eef33 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-7f6ccf4d-5583-443b-84e7-a8ef66d32bf1-delete_snapshot" released by "delete_snapshot" :: held 1.544s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-db91bdd5-c03f-4f82-a2da-b580da80ab07 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-db91bdd5-c03f-4f82-a2da-b580da80ab07 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:52 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-db91bdd5-c03f-4f82-a2da-b580da80ab07 tempest-ProjectMemberTests-1927748625 None] Creating offline snapshot d33d46ea-10c9-47c4-8923-ecdafc33fd07 of volume e09812b0-65c8-46e3-99df-abc2b9f03d4b {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:18:52 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc24580-3845-4f66-a84c-bf13a21e9bbd]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-db91bdd5-c03f-4f82-a2da-b580da80ab07 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:52 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b Sep 01 02:18:52 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2f18e43e-a5d8-461d-8ebb-029645fd01d3 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "cinder-577a5f08-84da-4e7c-85dc-dab10f96ab24-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2f18e43e-a5d8-461d-8ebb-029645fd01d3 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-577a5f08-84da-4e7c-85dc-dab10f96ab24-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2f18e43e-a5d8-461d-8ebb-029645fd01d3 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "cinder-quobyte-577a5f08-84da-4e7c-85dc-dab10f96ab24" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2f18e43e-a5d8-461d-8ebb-029645fd01d3 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-quobyte-577a5f08-84da-4e7c-85dc-dab10f96ab24" acquired by "delete_volume" :: waited 0.021s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:52 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fd7361-c32d-4ef0-b1e7-735e1e68a9cf]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2f18e43e-a5d8-461d-8ebb-029645fd01d3 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:52 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-db91bdd5-c03f-4f82-a2da-b580da80ab07 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b" returned: 0 in 0.372s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-db91bdd5-c03f-4f82-a2da-b580da80ab07 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b.d33d46ea-10c9-47c4-8923-ecdafc33fd07 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:52 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b.d33d46ea-10c9-47c4-8923-ecdafc33fd07 1G Sep 01 02:18:52 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:52 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24 Sep 01 02:18:52 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:52 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2f18e43e-a5d8-461d-8ebb-029645fd01d3 tempest-ProjectReaderTests-1438211366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24" returned: 0 in 0.385s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2f18e43e-a5d8-461d-8ebb-029645fd01d3 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:52 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24 Sep 01 02:18:52 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:52 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-db91bdd5-c03f-4f82-a2da-b580da80ab07 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b.d33d46ea-10c9-47c4-8923-ecdafc33fd07 1G" returned: 0 in 0.420s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-db91bdd5-c03f-4f82-a2da-b580da80ab07 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b.d33d46ea-10c9-47c4-8923-ecdafc33fd07 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:52 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b.d33d46ea-10c9-47c4-8923-ecdafc33fd07 Sep 01 02:18:52 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:52 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2f18e43e-a5d8-461d-8ebb-029645fd01d3 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-577a5f08-84da-4e7c-85dc-dab10f96ab24" returned: 0 in 0.253s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2f18e43e-a5d8-461d-8ebb-029645fd01d3 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-quobyte-577a5f08-84da-4e7c-85dc-dab10f96ab24" released by "delete_volume" :: held 0.702s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-2f18e43e-a5d8-461d-8ebb-029645fd01d3 tempest-ProjectReaderTests-1438211366 None] Created reservations ['e8c72075-08db-45e2-9bfe-20499c41f0cc', 'a264c51a-30c7-4122-8e70-980257fe7e77', 'afa6ba72-2871-4e57-ad9d-331ad1fea5b2', '909fcc33-4960-4191-892e-ac08e3205cfb'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:53 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-db91bdd5-c03f-4f82-a2da-b580da80ab07 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b.d33d46ea-10c9-47c4-8923-ecdafc33fd07" returned: 0 in 0.317s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:53 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-db91bdd5-c03f-4f82-a2da-b580da80ab07 tempest-ProjectMemberTests-1927748625 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b.d33d46ea-10c9-47c4-8923-ecdafc33fd07 is being set with open permissions: ugo+rw Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-db91bdd5-c03f-4f82-a2da-b580da80ab07 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b.d33d46ea-10c9-47c4-8923-ecdafc33fd07 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2f18e43e-a5d8-461d-8ebb-029645fd01d3 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2f18e43e-a5d8-461d-8ebb-029645fd01d3 tempest-ProjectReaderTests-1438211366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:53 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b.d33d46ea-10c9-47c4-8923-ecdafc33fd07 Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2f18e43e-a5d8-461d-8ebb-029645fd01d3 tempest-ProjectReaderTests-1438211366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:53 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-2f18e43e-a5d8-461d-8ebb-029645fd01d3 tempest-ProjectReaderTests-1438211366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-2f18e43e-a5d8-461d-8ebb-029645fd01d3 tempest-ProjectReaderTests-1438211366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2f18e43e-a5d8-461d-8ebb-029645fd01d3 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:53 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:18:53 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:53 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-db91bdd5-c03f-4f82-a2da-b580da80ab07 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b.d33d46ea-10c9-47c4-8923-ecdafc33fd07" returned: 0 in 0.251s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:53 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-db91bdd5-c03f-4f82-a2da-b580da80ab07 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2f18e43e-a5d8-461d-8ebb-029645fd01d3 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.256s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-2f18e43e-a5d8-461d-8ebb-029645fd01d3 tempest-ProjectReaderTests-1438211366 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:53 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-2f18e43e-a5d8-461d-8ebb-029645fd01d3 tempest-ProjectReaderTests-1438211366 None] Deleted volume successfully. Sep 01 02:18:53 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b.info Sep 01 02:18:53 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2f18e43e-a5d8-461d-8ebb-029645fd01d3 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-577a5f08-84da-4e7c-85dc-dab10f96ab24-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:53 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-db91bdd5-c03f-4f82-a2da-b580da80ab07 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b.info" returned: 0 in 0.250s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:53 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-db91bdd5-c03f-4f82-a2da-b580da80ab07 tempest-ProjectMemberTests-1927748625 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b.info is being set with open permissions: ugo+rw Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-db91bdd5-c03f-4f82-a2da-b580da80ab07 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:53 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b.info Sep 01 02:18:53 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] Flow 'volume_create_manager' (857621f0-b746-41c8-a680-7798051bc505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a711eee9-23fe-4d2f-938e-2cdf1e490f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:53 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a711eee9-23fe-4d2f-938e-2cdf1e490f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-512619061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19db76e3-084c-4688-a4ea-933d380e3af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d058dbf4e44e93bebda8c4e31386c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:54Z,use_quota=True,user_id='b9d99efedc644ff2a9d2817061a6b9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993fd691-e415-4229-9630-1e78566775fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993fd691-e415-4229-9630-1e78566775fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5e54e23-6cd7-4847-a7e1-776187b06a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5e54e23-6cd7-4847-a7e1-776187b06a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19db76e3-084c-4688-a4ea-933d380e3af0', 'volume_name': 'volume-19db76e3-084c-4688-a4ea-933d380e3af0', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3245e4cc-4f60-4868-82cf-dfebb1f5383d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3245e4cc-4f60-4868-82cf-dfebb1f5383d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea2d703c-53a5-4bf8-abc2-98935de0fce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:53 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] Volume 19db76e3-084c-4688-a4ea-933d380e3af0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19db76e3-084c-4688-a4ea-933d380e3af0', 'volume_size': 1} Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-db91bdd5-c03f-4f82-a2da-b580da80ab07 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b.info" returned: 0 in 0.307s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-db91bdd5-c03f-4f82-a2da-b580da80ab07 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.997s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.019s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-512619061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19db76e3-084c-4688-a4ea-933d380e3af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d058dbf4e44e93bebda8c4e31386c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:54Z,use_quota=True,user_id='b9d99efedc644ff2a9d2817061a6b9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] Creating volume 19db76e3-084c-4688-a4ea-933d380e3af0 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:54 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:18:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:54 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0 1073741824 Sep 01 02:18:54 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:54 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-db91bdd5-c03f-4f82-a2da-b580da80ab07 tempest-ProjectMemberTests-1927748625 None] Create snapshot completed successfully Sep 01 02:18:54 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0 1073741824" returned: 0 in 0.403s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:54 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0 Sep 01 02:18:54 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:54 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0" returned: 0 in 0.228s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea2d703c-53a5-4bf8-abc2-98935de0fce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19db76e3-084c-4688-a4ea-933d380e3af0', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b8c43aa-40be-4616-8ae9-55686a2d3aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:54 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] Volume volume-19db76e3-084c-4688-a4ea-933d380e3af0 (19db76e3-084c-4688-a4ea-933d380e3af0): created successfully Sep 01 02:18:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b8c43aa-40be-4616-8ae9-55686a2d3aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:54 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] Flow 'volume_create_manager' (857621f0-b746-41c8-a680-7798051bc505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:54 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-3ee66e4f-ea42-4161-bca5-4f901e2275e7 tempest-ProjectReaderTests-1438211366 None] Created volume successfully. Sep 01 02:18:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d62579d9-4ce4-4d3a-a6cb-a84e8ab235ac tempest-ProjectReaderTests-1438211366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d62579d9-4ce4-4d3a-a6cb-a84e8ab235ac tempest-ProjectReaderTests-1438211366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:55 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-d62579d9-4ce4-4d3a-a6cb-a84e8ab235ac tempest-ProjectReaderTests-1438211366 None] Creating offline snapshot 4965d9ca-170f-4590-96b1-a4d419ebb8bf of volume 19db76e3-084c-4688-a4ea-933d380e3af0 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:18:55 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[e767e2a1-ae4a-4a53-bb08-eb14db78f33d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d62579d9-4ce4-4d3a-a6cb-a84e8ab235ac tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:55 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6e065307-cafe-41cd-95b5-0e86bc3a1f31 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-d33d46ea-10c9-47c4-8923-ecdafc33fd07-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:55 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6e065307-cafe-41cd-95b5-0e86bc3a1f31 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-d33d46ea-10c9-47c4-8923-ecdafc33fd07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:55 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6e065307-cafe-41cd-95b5-0e86bc3a1f31 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-quobyte-e09812b0-65c8-46e3-99df-abc2b9f03d4b" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:55 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0 Sep 01 02:18:55 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:55 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6e065307-cafe-41cd-95b5-0e86bc3a1f31 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-e09812b0-65c8-46e3-99df-abc2b9f03d4b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:55 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6e065307-cafe-41cd-95b5-0e86bc3a1f31 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-quobyte-d33d46ea-10c9-47c4-8923-ecdafc33fd07" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:55 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6e065307-cafe-41cd-95b5-0e86bc3a1f31 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-d33d46ea-10c9-47c4-8923-ecdafc33fd07" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:55 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-6e065307-cafe-41cd-95b5-0e86bc3a1f31 tempest-ProjectMemberTests-1927748625 None] Deleting offline snapshot d33d46ea-10c9-47c4-8923-ecdafc33fd07 of volume e09812b0-65c8-46e3-99df-abc2b9f03d4b {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:18:55 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-6e065307-cafe-41cd-95b5-0e86bc3a1f31 tempest-ProjectMemberTests-1927748625 None] snapshot_file for this snap is: volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b.d33d46ea-10c9-47c4-8923-ecdafc33fd07 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:18:55 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb423cc2-09be-4e73-aa91-b24125bdc99f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6e065307-cafe-41cd-95b5-0e86bc3a1f31 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b.d33d46ea-10c9-47c4-8923-ecdafc33fd07 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:55 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b.d33d46ea-10c9-47c4-8923-ecdafc33fd07 Sep 01 02:18:55 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:55 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d62579d9-4ce4-4d3a-a6cb-a84e8ab235ac tempest-ProjectReaderTests-1438211366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0" returned: 0 in 0.385s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d62579d9-4ce4-4d3a-a6cb-a84e8ab235ac tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0.4965d9ca-170f-4590-96b1-a4d419ebb8bf 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:55 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0.4965d9ca-170f-4590-96b1-a4d419ebb8bf 1G Sep 01 02:18:55 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:55 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6e065307-cafe-41cd-95b5-0e86bc3a1f31 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b.d33d46ea-10c9-47c4-8923-ecdafc33fd07" returned: 0 in 0.355s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:55 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-6e065307-cafe-41cd-95b5-0e86bc3a1f31 tempest-ProjectMemberTests-1927748625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:18:55 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[52328e7f-479e-4d37-9171-d0337bdcd15f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6e065307-cafe-41cd-95b5-0e86bc3a1f31 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:55 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b Sep 01 02:18:55 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:55 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d62579d9-4ce4-4d3a-a6cb-a84e8ab235ac tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0.4965d9ca-170f-4590-96b1-a4d419ebb8bf 1G" returned: 0 in 0.383s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d62579d9-4ce4-4d3a-a6cb-a84e8ab235ac tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19db76e3-084c-4688-a4ea-933d380e3af0 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0.4965d9ca-170f-4590-96b1-a4d419ebb8bf {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:55 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19db76e3-084c-4688-a4ea-933d380e3af0 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0.4965d9ca-170f-4590-96b1-a4d419ebb8bf Sep 01 02:18:55 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:55 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6e065307-cafe-41cd-95b5-0e86bc3a1f31 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b" returned: 0 in 0.375s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6e065307-cafe-41cd-95b5-0e86bc3a1f31 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b.d33d46ea-10c9-47c4-8923-ecdafc33fd07 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:56 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b.d33d46ea-10c9-47c4-8923-ecdafc33fd07 Sep 01 02:18:56 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:56 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d62579d9-4ce4-4d3a-a6cb-a84e8ab235ac tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19db76e3-084c-4688-a4ea-933d380e3af0 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0.4965d9ca-170f-4590-96b1-a4d419ebb8bf" returned: 0 in 0.292s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:56 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-d62579d9-4ce4-4d3a-a6cb-a84e8ab235ac tempest-ProjectReaderTests-1438211366 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0.4965d9ca-170f-4590-96b1-a4d419ebb8bf is being set with open permissions: ugo+rw Sep 01 02:18:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d62579d9-4ce4-4d3a-a6cb-a84e8ab235ac tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0.4965d9ca-170f-4590-96b1-a4d419ebb8bf {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:56 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0.4965d9ca-170f-4590-96b1-a4d419ebb8bf Sep 01 02:18:56 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:56 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6e065307-cafe-41cd-95b5-0e86bc3a1f31 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b.d33d46ea-10c9-47c4-8923-ecdafc33fd07" returned: 0 in 0.327s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6e065307-cafe-41cd-95b5-0e86bc3a1f31 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b.d33d46ea-10c9-47c4-8923-ecdafc33fd07 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:56 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b.d33d46ea-10c9-47c4-8923-ecdafc33fd07 Sep 01 02:18:56 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:56 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d62579d9-4ce4-4d3a-a6cb-a84e8ab235ac tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0.4965d9ca-170f-4590-96b1-a4d419ebb8bf" returned: 0 in 0.255s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d62579d9-4ce4-4d3a-a6cb-a84e8ab235ac tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:56 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0.info Sep 01 02:18:56 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:56 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6e065307-cafe-41cd-95b5-0e86bc3a1f31 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b.d33d46ea-10c9-47c4-8923-ecdafc33fd07" returned: 0 in 0.251s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:56 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6e065307-cafe-41cd-95b5-0e86bc3a1f31 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-d33d46ea-10c9-47c4-8923-ecdafc33fd07" released by "_delete_snapshot" :: held 1.397s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:56 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6e065307-cafe-41cd-95b5-0e86bc3a1f31 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-e09812b0-65c8-46e3-99df-abc2b9f03d4b" released by "delete_snapshot" :: held 1.420s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:56 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d62579d9-4ce4-4d3a-a6cb-a84e8ab235ac tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0.info" returned: 0 in 0.251s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:56 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-d62579d9-4ce4-4d3a-a6cb-a84e8ab235ac tempest-ProjectReaderTests-1438211366 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0.info is being set with open permissions: ugo+rw Sep 01 02:18:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d62579d9-4ce4-4d3a-a6cb-a84e8ab235ac tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:56 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0.info Sep 01 02:18:56 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:56 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-6e065307-cafe-41cd-95b5-0e86bc3a1f31 tempest-ProjectMemberTests-1927748625 None] Created reservations ['0a2660c4-1ca0-4a3d-b678-fce2e1e4610f', '7e6ec2b5-1f4c-44ff-b869-d6fbf37482a4', '368cef6f-4e11-4910-aea0-e7d0a5d97c70', 'ba9d286b-be71-49b7-8851-bc0fbe28d39f'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:56 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-6e065307-cafe-41cd-95b5-0e86bc3a1f31 tempest-ProjectMemberTests-1927748625 None] Delete snapshot completed successfully. Sep 01 02:18:56 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6e065307-cafe-41cd-95b5-0e86bc3a1f31 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-d33d46ea-10c9-47c4-8923-ecdafc33fd07-delete_snapshot" released by "delete_snapshot" :: held 1.586s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:56 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d62579d9-4ce4-4d3a-a6cb-a84e8ab235ac tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0.info" returned: 0 in 0.246s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d62579d9-4ce4-4d3a-a6cb-a84e8ab235ac tempest-ProjectReaderTests-1438211366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.893s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:56 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-d62579d9-4ce4-4d3a-a6cb-a84e8ab235ac tempest-ProjectReaderTests-1438211366 None] Create snapshot completed successfully Sep 01 02:18:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7af90c2b-91c3-4744-b2da-67e161b4d570 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "cinder-4965d9ca-170f-4590-96b1-a4d419ebb8bf-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7af90c2b-91c3-4744-b2da-67e161b4d570 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-4965d9ca-170f-4590-96b1-a4d419ebb8bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7af90c2b-91c3-4744-b2da-67e161b4d570 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "cinder-quobyte-19db76e3-084c-4688-a4ea-933d380e3af0" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7af90c2b-91c3-4744-b2da-67e161b4d570 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-quobyte-19db76e3-084c-4688-a4ea-933d380e3af0" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7af90c2b-91c3-4744-b2da-67e161b4d570 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "cinder-quobyte-4965d9ca-170f-4590-96b1-a4d419ebb8bf" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7af90c2b-91c3-4744-b2da-67e161b4d570 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-quobyte-4965d9ca-170f-4590-96b1-a4d419ebb8bf" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-7af90c2b-91c3-4744-b2da-67e161b4d570 tempest-ProjectReaderTests-1438211366 None] Deleting offline snapshot 4965d9ca-170f-4590-96b1-a4d419ebb8bf of volume 19db76e3-084c-4688-a4ea-933d380e3af0 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:18:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-7af90c2b-91c3-4744-b2da-67e161b4d570 tempest-ProjectReaderTests-1438211366 None] snapshot_file for this snap is: volume-19db76e3-084c-4688-a4ea-933d380e3af0.4965d9ca-170f-4590-96b1-a4d419ebb8bf {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:18:57 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e041767-4ee6-4b11-ac2d-24ccda26311e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7af90c2b-91c3-4744-b2da-67e161b4d570 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0.4965d9ca-170f-4590-96b1-a4d419ebb8bf {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6b944dfd-f40d-4413-9ecd-8253fef236c6 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-e09812b0-65c8-46e3-99df-abc2b9f03d4b-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:57 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0.4965d9ca-170f-4590-96b1-a4d419ebb8bf Sep 01 02:18:57 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6b944dfd-f40d-4413-9ecd-8253fef236c6 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-e09812b0-65c8-46e3-99df-abc2b9f03d4b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6b944dfd-f40d-4413-9ecd-8253fef236c6 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-quobyte-e09812b0-65c8-46e3-99df-abc2b9f03d4b" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6b944dfd-f40d-4413-9ecd-8253fef236c6 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-e09812b0-65c8-46e3-99df-abc2b9f03d4b" acquired by "delete_volume" :: waited 0.018s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:57 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c023e33-6e5f-445a-a38c-3bfc3e6f4401]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6b944dfd-f40d-4413-9ecd-8253fef236c6 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:57 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b Sep 01 02:18:57 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:57 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7af90c2b-91c3-4744-b2da-67e161b4d570 tempest-ProjectReaderTests-1438211366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0.4965d9ca-170f-4590-96b1-a4d419ebb8bf" returned: 0 in 0.357s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-7af90c2b-91c3-4744-b2da-67e161b4d570 tempest-ProjectReaderTests-1438211366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19db76e3-084c-4688-a4ea-933d380e3af0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:18:57 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ca6b23-a546-42bb-958c-638e471be3d3]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7af90c2b-91c3-4744-b2da-67e161b4d570 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:57 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0 Sep 01 02:18:57 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:57 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6b944dfd-f40d-4413-9ecd-8253fef236c6 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b" returned: 0 in 0.358s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6b944dfd-f40d-4413-9ecd-8253fef236c6 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:57 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b Sep 01 02:18:57 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:57 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7af90c2b-91c3-4744-b2da-67e161b4d570 tempest-ProjectReaderTests-1438211366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0" returned: 0 in 0.366s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7af90c2b-91c3-4744-b2da-67e161b4d570 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0.4965d9ca-170f-4590-96b1-a4d419ebb8bf {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:57 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0.4965d9ca-170f-4590-96b1-a4d419ebb8bf Sep 01 02:18:57 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:58 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6b944dfd-f40d-4413-9ecd-8253fef236c6 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-e09812b0-65c8-46e3-99df-abc2b9f03d4b" returned: 0 in 0.251s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6b944dfd-f40d-4413-9ecd-8253fef236c6 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-e09812b0-65c8-46e3-99df-abc2b9f03d4b" released by "delete_volume" :: held 0.666s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-6b944dfd-f40d-4413-9ecd-8253fef236c6 tempest-ProjectMemberTests-1927748625 None] Created reservations ['9c0ae4ba-8bc9-4aa4-b259-52df276e8969', 'b7f2d765-bc09-440b-9ce1-56ec0b202c36', '722b9a9f-f4c6-43f6-9c19-25489f369b21', '7a492e35-667c-4951-a496-d217483ba1fc'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6b944dfd-f40d-4413-9ecd-8253fef236c6 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6b944dfd-f40d-4413-9ecd-8253fef236c6 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-6b944dfd-f40d-4413-9ecd-8253fef236c6 tempest-ProjectMemberTests-1927748625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-6b944dfd-f40d-4413-9ecd-8253fef236c6 tempest-ProjectMemberTests-1927748625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-6b944dfd-f40d-4413-9ecd-8253fef236c6 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6b944dfd-f40d-4413-9ecd-8253fef236c6 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:58 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:18:58 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:58 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7af90c2b-91c3-4744-b2da-67e161b4d570 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0.4965d9ca-170f-4590-96b1-a4d419ebb8bf" returned: 0 in 0.354s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7af90c2b-91c3-4744-b2da-67e161b4d570 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0.4965d9ca-170f-4590-96b1-a4d419ebb8bf {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:58 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0.4965d9ca-170f-4590-96b1-a4d419ebb8bf Sep 01 02:18:58 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:58 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6b944dfd-f40d-4413-9ecd-8253fef236c6 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.258s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-6b944dfd-f40d-4413-9ecd-8253fef236c6 tempest-ProjectMemberTests-1927748625 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:58 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-6b944dfd-f40d-4413-9ecd-8253fef236c6 tempest-ProjectMemberTests-1927748625 None] Deleted volume successfully. Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6b944dfd-f40d-4413-9ecd-8253fef236c6 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-e09812b0-65c8-46e3-99df-abc2b9f03d4b-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:58 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7af90c2b-91c3-4744-b2da-67e161b4d570 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0.4965d9ca-170f-4590-96b1-a4d419ebb8bf" returned: 0 in 0.266s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7af90c2b-91c3-4744-b2da-67e161b4d570 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-quobyte-4965d9ca-170f-4590-96b1-a4d419ebb8bf" released by "_delete_snapshot" :: held 1.427s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7af90c2b-91c3-4744-b2da-67e161b4d570 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-quobyte-19db76e3-084c-4688-a4ea-933d380e3af0" released by "delete_snapshot" :: held 1.447s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-7af90c2b-91c3-4744-b2da-67e161b4d570 tempest-ProjectReaderTests-1438211366 None] Created reservations ['6e7e2734-18a0-4a24-a11b-77944427224f', '23f7965d-87e1-4ed8-8f75-38d1c91fe9bd', '3fa5e338-5430-4c8a-809b-cb1b74c612ff', '184a3188-a109-4ced-b456-6cb1068f58a0'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:58 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-7af90c2b-91c3-4744-b2da-67e161b4d570 tempest-ProjectReaderTests-1438211366 None] Delete snapshot completed successfully. Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7af90c2b-91c3-4744-b2da-67e161b4d570 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-4965d9ca-170f-4590-96b1-a4d419ebb8bf-delete_snapshot" released by "delete_snapshot" :: held 1.578s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] Flow 'volume_create_manager' (e4edd85c-014d-4c4b-960c-dcc1a40d9346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7befbb4d-3854-484a-8dda-ad760510d4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7befbb4d-3854-484a-8dda-ad760510d4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2132126705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4244a184-5f80-41c1-867c-9307cac3c671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61578a8868584ca29ab081523d408c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:59Z,use_quota=True,user_id='f2911f91e5124a7ba8862f4b148bf6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af47f3b-431c-40cf-9681-ad4db5cd8465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af47f3b-431c-40cf-9681-ad4db5cd8465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd234a2e-a63b-4ff2-b96f-b8af2c9d2db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd234a2e-a63b-4ff2-b96f-b8af2c9d2db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4244a184-5f80-41c1-867c-9307cac3c671', 'volume_name': 'volume-4244a184-5f80-41c1-867c-9307cac3c671', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223e68e9-4e15-4188-9d9e-07205b16ac15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223e68e9-4e15-4188-9d9e-07205b16ac15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7971daa-3be1-4844-a123-3382f6ddf997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:58 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] Volume 4244a184-5f80-41c1-867c-9307cac3c671: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4244a184-5f80-41c1-867c-9307cac3c671', 'volume_size': 1} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2132126705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4244a184-5f80-41c1-867c-9307cac3c671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61578a8868584ca29ab081523d408c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:59Z,use_quota=True,user_id='f2911f91e5124a7ba8862f4b148bf6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] Creating volume 4244a184-5f80-41c1-867c-9307cac3c671 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:58 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:18:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:59 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671 1073741824 Sep 01 02:18:59 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:59 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fa52dac1-bc08-4f7e-a4f6-74ecf895ca27 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "cinder-19db76e3-084c-4688-a4ea-933d380e3af0-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:59 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fa52dac1-bc08-4f7e-a4f6-74ecf895ca27 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-19db76e3-084c-4688-a4ea-933d380e3af0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:59 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fa52dac1-bc08-4f7e-a4f6-74ecf895ca27 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "cinder-quobyte-19db76e3-084c-4688-a4ea-933d380e3af0" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:59 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fa52dac1-bc08-4f7e-a4f6-74ecf895ca27 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-quobyte-19db76e3-084c-4688-a4ea-933d380e3af0" acquired by "delete_volume" :: waited 0.018s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:59 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[014a8bc1-fe04-466d-a91e-c4c5047cd24e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fa52dac1-bc08-4f7e-a4f6-74ecf895ca27 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:59 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671 1073741824" returned: 0 in 0.442s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:59 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671 Sep 01 02:18:59 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:59 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0 Sep 01 02:18:59 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:59 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671" returned: 0 in 0.245s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:59 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:59 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7971daa-3be1-4844-a123-3382f6ddf997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4244a184-5f80-41c1-867c-9307cac3c671', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:59 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd1fdf4e-bfb0-4273-8982-a7369214891b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:59 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] Volume volume-4244a184-5f80-41c1-867c-9307cac3c671 (4244a184-5f80-41c1-867c-9307cac3c671): created successfully Sep 01 02:18:59 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd1fdf4e-bfb0-4273-8982-a7369214891b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:59 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] Flow 'volume_create_manager' (e4edd85c-014d-4c4b-960c-dcc1a40d9346) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:59 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fa52dac1-bc08-4f7e-a4f6-74ecf895ca27 tempest-ProjectReaderTests-1438211366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0" returned: 0 in 0.362s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fa52dac1-bc08-4f7e-a4f6-74ecf895ca27 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:59 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-92657272-880c-4b32-ac85-88f4b777af14 tempest-ProjectMemberTests-1927748625 None] Created volume successfully. Sep 01 02:18:59 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0 Sep 01 02:18:59 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:00 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fa52dac1-bc08-4f7e-a4f6-74ecf895ca27 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-19db76e3-084c-4688-a4ea-933d380e3af0" returned: 0 in 0.267s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:00 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fa52dac1-bc08-4f7e-a4f6-74ecf895ca27 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-quobyte-19db76e3-084c-4688-a4ea-933d380e3af0" released by "delete_volume" :: held 0.692s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f3629a33-4039-4e57-8c8d-f2aaf85e0904 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f3629a33-4039-4e57-8c8d-f2aaf85e0904 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:00 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-f3629a33-4039-4e57-8c8d-f2aaf85e0904 tempest-ProjectMemberTests-1927748625 None] Creating offline snapshot 62f601de-972a-4280-8617-a27421c5ecb9 of volume 4244a184-5f80-41c1-867c-9307cac3c671 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:19:00 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9123293-0766-4190-95a5-81d64bfcb6cf]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f3629a33-4039-4e57-8c8d-f2aaf85e0904 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:00 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-fa52dac1-bc08-4f7e-a4f6-74ecf895ca27 tempest-ProjectReaderTests-1438211366 None] Created reservations ['be6137a6-980b-4b9d-9c79-7c39a7a704bf', '18a714e8-2986-4abe-a4dd-44b20526d2aa', 'd4dc81b9-6309-45f6-9d74-fbb6206bf921', 'de392010-e38e-4503-94a6-8042564b4824'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fa52dac1-bc08-4f7e-a4f6-74ecf895ca27 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fa52dac1-bc08-4f7e-a4f6-74ecf895ca27 tempest-ProjectReaderTests-1438211366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:00 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fa52dac1-bc08-4f7e-a4f6-74ecf895ca27 tempest-ProjectReaderTests-1438211366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:00 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-fa52dac1-bc08-4f7e-a4f6-74ecf895ca27 tempest-ProjectReaderTests-1438211366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-fa52dac1-bc08-4f7e-a4f6-74ecf895ca27 tempest-ProjectReaderTests-1438211366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fa52dac1-bc08-4f7e-a4f6-74ecf895ca27 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:00 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671 Sep 01 02:19:00 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:00 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:19:00 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:00 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-fa52dac1-bc08-4f7e-a4f6-74ecf895ca27 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.244s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:00 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-fa52dac1-bc08-4f7e-a4f6-74ecf895ca27 tempest-ProjectReaderTests-1438211366 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:00 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-fa52dac1-bc08-4f7e-a4f6-74ecf895ca27 tempest-ProjectReaderTests-1438211366 None] Deleted volume successfully. Sep 01 02:19:00 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-fa52dac1-bc08-4f7e-a4f6-74ecf895ca27 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-19db76e3-084c-4688-a4ea-933d380e3af0-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:00 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f3629a33-4039-4e57-8c8d-f2aaf85e0904 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671" returned: 0 in 0.384s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f3629a33-4039-4e57-8c8d-f2aaf85e0904 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671.62f601de-972a-4280-8617-a27421c5ecb9 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:00 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671.62f601de-972a-4280-8617-a27421c5ecb9 1G Sep 01 02:19:00 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:00 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:19:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] Flow 'volume_create_manager' (a065f278-8448-4f48-a8ea-a521925426aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:00 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5891c1e2-90aa-449a-8710-ceefee6e0ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:00 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f3629a33-4039-4e57-8c8d-f2aaf85e0904 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671.62f601de-972a-4280-8617-a27421c5ecb9 1G" returned: 0 in 0.465s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f3629a33-4039-4e57-8c8d-f2aaf85e0904 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4244a184-5f80-41c1-867c-9307cac3c671 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671.62f601de-972a-4280-8617-a27421c5ecb9 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5891c1e2-90aa-449a-8710-ceefee6e0ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-933681700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2a7675d-1b69-45ee-99c4-9fe861c83f4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d058dbf4e44e93bebda8c4e31386c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:01Z,use_quota=True,user_id='b9d99efedc644ff2a9d2817061a6b9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:01 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4244a184-5f80-41c1-867c-9307cac3c671 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671.62f601de-972a-4280-8617-a27421c5ecb9 Sep 01 02:19:01 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab09d433-62a4-462b-b8e1-5923f2d06df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab09d433-62a4-462b-b8e1-5923f2d06df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a207310-72f0-4226-b0da-57277e9c2cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a207310-72f0-4226-b0da-57277e9c2cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2a7675d-1b69-45ee-99c4-9fe861c83f4c', 'volume_name': 'volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f1b632e-e1d5-4c3f-9c58-c43e4b392f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f1b632e-e1d5-4c3f-9c58-c43e4b392f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:01 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4cb1d0-702a-4f55-84c9-b243106f4642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:01 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] Volume c2a7675d-1b69-45ee-99c4-9fe861c83f4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c', 'volume_size': 1} Sep 01 02:19:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:01 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f3629a33-4039-4e57-8c8d-f2aaf85e0904 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4244a184-5f80-41c1-867c-9307cac3c671 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671.62f601de-972a-4280-8617-a27421c5ecb9" returned: 0 in 0.277s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:01 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-f3629a33-4039-4e57-8c8d-f2aaf85e0904 tempest-ProjectMemberTests-1927748625 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671.62f601de-972a-4280-8617-a27421c5ecb9 is being set with open permissions: ugo+rw Sep 01 02:19:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f3629a33-4039-4e57-8c8d-f2aaf85e0904 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671.62f601de-972a-4280-8617-a27421c5ecb9 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:01 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671.62f601de-972a-4280-8617-a27421c5ecb9 Sep 01 02:19:01 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:01 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f3629a33-4039-4e57-8c8d-f2aaf85e0904 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671.62f601de-972a-4280-8617-a27421c5ecb9" returned: 0 in 0.228s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f3629a33-4039-4e57-8c8d-f2aaf85e0904 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:01 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671.info Sep 01 02:19:01 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:01 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f3629a33-4039-4e57-8c8d-f2aaf85e0904 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671.info" returned: 0 in 0.243s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:01 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-f3629a33-4039-4e57-8c8d-f2aaf85e0904 tempest-ProjectMemberTests-1927748625 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671.info is being set with open permissions: ugo+rw Sep 01 02:19:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f3629a33-4039-4e57-8c8d-f2aaf85e0904 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:01 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671.info Sep 01 02:19:01 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:01 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:01 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f3629a33-4039-4e57-8c8d-f2aaf85e0904 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671.info" returned: 0 in 0.230s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f3629a33-4039-4e57-8c8d-f2aaf85e0904 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.916s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.969s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-933681700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2a7675d-1b69-45ee-99c4-9fe861c83f4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d058dbf4e44e93bebda8c4e31386c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:01Z,use_quota=True,user_id='b9d99efedc644ff2a9d2817061a6b9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] Creating volume c2a7675d-1b69-45ee-99c4-9fe861c83f4c {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:19:02 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:02 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c 1073741824 Sep 01 02:19:02 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:02 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-f3629a33-4039-4e57-8c8d-f2aaf85e0904 tempest-ProjectMemberTests-1927748625 None] Create snapshot completed successfully Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9f05894c-850f-4e71-a769-3293647e5142 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-62f601de-972a-4280-8617-a27421c5ecb9-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9f05894c-850f-4e71-a769-3293647e5142 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-62f601de-972a-4280-8617-a27421c5ecb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9f05894c-850f-4e71-a769-3293647e5142 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-quobyte-4244a184-5f80-41c1-867c-9307cac3c671" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9f05894c-850f-4e71-a769-3293647e5142 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-4244a184-5f80-41c1-867c-9307cac3c671" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9f05894c-850f-4e71-a769-3293647e5142 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-quobyte-62f601de-972a-4280-8617-a27421c5ecb9" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9f05894c-850f-4e71-a769-3293647e5142 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-62f601de-972a-4280-8617-a27421c5ecb9" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-9f05894c-850f-4e71-a769-3293647e5142 tempest-ProjectMemberTests-1927748625 None] Deleting offline snapshot 62f601de-972a-4280-8617-a27421c5ecb9 of volume 4244a184-5f80-41c1-867c-9307cac3c671 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-9f05894c-850f-4e71-a769-3293647e5142 tempest-ProjectMemberTests-1927748625 None] snapshot_file for this snap is: volume-4244a184-5f80-41c1-867c-9307cac3c671.62f601de-972a-4280-8617-a27421c5ecb9 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[908b0513-847c-4c4d-8e8e-daab87d4d85d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9f05894c-850f-4e71-a769-3293647e5142 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671.62f601de-972a-4280-8617-a27421c5ecb9 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:02 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671.62f601de-972a-4280-8617-a27421c5ecb9 Sep 01 02:19:02 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:02 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c 1073741824" returned: 0 in 0.453s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:02 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c Sep 01 02:19:02 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:02 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9f05894c-850f-4e71-a769-3293647e5142 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671.62f601de-972a-4280-8617-a27421c5ecb9" returned: 0 in 0.364s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-9f05894c-850f-4e71-a769-3293647e5142 tempest-ProjectMemberTests-1927748625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4244a184-5f80-41c1-867c-9307cac3c671(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8949d0-845d-4448-bd81-f885155e358d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9f05894c-850f-4e71-a769-3293647e5142 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:02 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c" returned: 0 in 0.252s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4cb1d0-702a-4f55-84c9-b243106f4642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386cd68d-c329-476e-9a8d-cd82bb44309a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:02 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] Volume volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c (c2a7675d-1b69-45ee-99c4-9fe861c83f4c): created successfully Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386cd68d-c329-476e-9a8d-cd82bb44309a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:02 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] Flow 'volume_create_manager' (a065f278-8448-4f48-a8ea-a521925426aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:02 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-4abe53b4-3a2f-4778-9e9b-64e3389a4b79 tempest-ProjectReaderTests-1438211366 None] Created volume successfully. Sep 01 02:19:02 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671 Sep 01 02:19:02 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:03 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9f05894c-850f-4e71-a769-3293647e5142 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671" returned: 0 in 0.389s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9f05894c-850f-4e71-a769-3293647e5142 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671.62f601de-972a-4280-8617-a27421c5ecb9 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-44f8df4c-d206-493a-a1fe-0ac5a7986800 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-44f8df4c-d206-493a-a1fe-0ac5a7986800 tempest-ProjectReaderTests-1438211366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:03 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671.62f601de-972a-4280-8617-a27421c5ecb9 Sep 01 02:19:03 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:03 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-44f8df4c-d206-493a-a1fe-0ac5a7986800 tempest-ProjectReaderTests-1438211366 None] Creating offline snapshot 193fcfb3-9670-4dbc-8c86-9f0b43068b6e of volume c2a7675d-1b69-45ee-99c4-9fe861c83f4c {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:19:03 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef21e0d7-f8a0-431f-9651-00498bc2d718]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-44f8df4c-d206-493a-a1fe-0ac5a7986800 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:03 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c Sep 01 02:19:03 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:03 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9f05894c-850f-4e71-a769-3293647e5142 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671.62f601de-972a-4280-8617-a27421c5ecb9" returned: 0 in 0.319s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9f05894c-850f-4e71-a769-3293647e5142 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671.62f601de-972a-4280-8617-a27421c5ecb9 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:03 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671.62f601de-972a-4280-8617-a27421c5ecb9 Sep 01 02:19:03 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:03 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-44f8df4c-d206-493a-a1fe-0ac5a7986800 tempest-ProjectReaderTests-1438211366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c" returned: 0 in 0.371s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-44f8df4c-d206-493a-a1fe-0ac5a7986800 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c.193fcfb3-9670-4dbc-8c86-9f0b43068b6e 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:03 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c.193fcfb3-9670-4dbc-8c86-9f0b43068b6e 1G Sep 01 02:19:03 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:03 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9f05894c-850f-4e71-a769-3293647e5142 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671.62f601de-972a-4280-8617-a27421c5ecb9" returned: 0 in 0.246s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:03 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9f05894c-850f-4e71-a769-3293647e5142 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-62f601de-972a-4280-8617-a27421c5ecb9" released by "_delete_snapshot" :: held 1.420s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:03 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9f05894c-850f-4e71-a769-3293647e5142 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-4244a184-5f80-41c1-867c-9307cac3c671" released by "delete_snapshot" :: held 1.490s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:03 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-9f05894c-850f-4e71-a769-3293647e5142 tempest-ProjectMemberTests-1927748625 None] Created reservations ['9c84a093-5fa1-420e-854f-8e9bebefbcaa', 'd97297dd-0bd8-4805-8324-076626b8279d', '2e75f7de-8a23-494d-b3c9-f1646c7d4d23', 'cece270e-8a83-4686-840b-d4670d423635'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:03 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-9f05894c-850f-4e71-a769-3293647e5142 tempest-ProjectMemberTests-1927748625 None] Delete snapshot completed successfully. Sep 01 02:19:03 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9f05894c-850f-4e71-a769-3293647e5142 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-62f601de-972a-4280-8617-a27421c5ecb9-delete_snapshot" released by "delete_snapshot" :: held 1.641s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:03 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-44f8df4c-d206-493a-a1fe-0ac5a7986800 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c.193fcfb3-9670-4dbc-8c86-9f0b43068b6e 1G" returned: 0 in 0.418s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:03 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-44f8df4c-d206-493a-a1fe-0ac5a7986800 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c.193fcfb3-9670-4dbc-8c86-9f0b43068b6e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:04 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c.193fcfb3-9670-4dbc-8c86-9f0b43068b6e Sep 01 02:19:04 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:04 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-44f8df4c-d206-493a-a1fe-0ac5a7986800 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c.193fcfb3-9670-4dbc-8c86-9f0b43068b6e" returned: 0 in 0.273s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:04 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-44f8df4c-d206-493a-a1fe-0ac5a7986800 tempest-ProjectReaderTests-1438211366 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c.193fcfb3-9670-4dbc-8c86-9f0b43068b6e is being set with open permissions: ugo+rw Sep 01 02:19:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-44f8df4c-d206-493a-a1fe-0ac5a7986800 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c.193fcfb3-9670-4dbc-8c86-9f0b43068b6e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:04 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c.193fcfb3-9670-4dbc-8c86-9f0b43068b6e Sep 01 02:19:04 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:04 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-34a76f7b-0c18-43c0-a2a7-a1de882b0a2e tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-4244a184-5f80-41c1-867c-9307cac3c671-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:04 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-34a76f7b-0c18-43c0-a2a7-a1de882b0a2e tempest-ProjectMemberTests-1927748625 None] Lock "cinder-4244a184-5f80-41c1-867c-9307cac3c671-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:04 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-34a76f7b-0c18-43c0-a2a7-a1de882b0a2e tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-quobyte-4244a184-5f80-41c1-867c-9307cac3c671" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:04 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-34a76f7b-0c18-43c0-a2a7-a1de882b0a2e tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-4244a184-5f80-41c1-867c-9307cac3c671" acquired by "delete_volume" :: waited 0.018s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:04 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f2790b-18f6-4cb3-a68e-b2cce8572c0f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-34a76f7b-0c18-43c0-a2a7-a1de882b0a2e tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:04 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-44f8df4c-d206-493a-a1fe-0ac5a7986800 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c.193fcfb3-9670-4dbc-8c86-9f0b43068b6e" returned: 0 in 0.261s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-44f8df4c-d206-493a-a1fe-0ac5a7986800 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:04 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c.info Sep 01 02:19:04 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:04 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671 Sep 01 02:19:04 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:04 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-44f8df4c-d206-493a-a1fe-0ac5a7986800 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c.info" returned: 0 in 0.244s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:04 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-44f8df4c-d206-493a-a1fe-0ac5a7986800 tempest-ProjectReaderTests-1438211366 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c.info is being set with open permissions: ugo+rw Sep 01 02:19:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-44f8df4c-d206-493a-a1fe-0ac5a7986800 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:04 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c.info Sep 01 02:19:04 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:04 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-34a76f7b-0c18-43c0-a2a7-a1de882b0a2e tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671" returned: 0 in 0.365s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:04 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-34a76f7b-0c18-43c0-a2a7-a1de882b0a2e tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:04 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671 Sep 01 02:19:04 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:05 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-44f8df4c-d206-493a-a1fe-0ac5a7986800 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c.info" returned: 0 in 0.250s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-44f8df4c-d206-493a-a1fe-0ac5a7986800 tempest-ProjectReaderTests-1438211366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.905s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:05 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-44f8df4c-d206-493a-a1fe-0ac5a7986800 tempest-ProjectReaderTests-1438211366 None] Create snapshot completed successfully Sep 01 02:19:05 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-34a76f7b-0c18-43c0-a2a7-a1de882b0a2e tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-4244a184-5f80-41c1-867c-9307cac3c671" returned: 0 in 0.245s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:05 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-34a76f7b-0c18-43c0-a2a7-a1de882b0a2e tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-4244a184-5f80-41c1-867c-9307cac3c671" released by "delete_volume" :: held 0.665s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:05 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-34a76f7b-0c18-43c0-a2a7-a1de882b0a2e tempest-ProjectMemberTests-1927748625 None] Created reservations ['2344f0aa-b262-4ff5-b53d-4cf5e60cc8b9', '36ac3791-aa31-4076-8d2f-81494dddcc59', 'f5945042-30ff-47ac-a642-30c6a66af1a7', 'c9daa252-6c7c-49e9-b655-c68e753aecc8'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-34a76f7b-0c18-43c0-a2a7-a1de882b0a2e tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-34a76f7b-0c18-43c0-a2a7-a1de882b0a2e tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:05 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-34a76f7b-0c18-43c0-a2a7-a1de882b0a2e tempest-ProjectMemberTests-1927748625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:05 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-34a76f7b-0c18-43c0-a2a7-a1de882b0a2e tempest-ProjectMemberTests-1927748625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-34a76f7b-0c18-43c0-a2a7-a1de882b0a2e tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-34a76f7b-0c18-43c0-a2a7-a1de882b0a2e tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:05 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6a6dee45-979f-46cc-a706-39feaa1a7f50 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "cinder-193fcfb3-9670-4dbc-8c86-9f0b43068b6e-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:05 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:19:05 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:05 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6a6dee45-979f-46cc-a706-39feaa1a7f50 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-193fcfb3-9670-4dbc-8c86-9f0b43068b6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:05 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6a6dee45-979f-46cc-a706-39feaa1a7f50 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "cinder-quobyte-c2a7675d-1b69-45ee-99c4-9fe861c83f4c" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:05 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6a6dee45-979f-46cc-a706-39feaa1a7f50 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-quobyte-c2a7675d-1b69-45ee-99c4-9fe861c83f4c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:05 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6a6dee45-979f-46cc-a706-39feaa1a7f50 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "cinder-quobyte-193fcfb3-9670-4dbc-8c86-9f0b43068b6e" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:05 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6a6dee45-979f-46cc-a706-39feaa1a7f50 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-quobyte-193fcfb3-9670-4dbc-8c86-9f0b43068b6e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:05 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-6a6dee45-979f-46cc-a706-39feaa1a7f50 tempest-ProjectReaderTests-1438211366 None] Deleting offline snapshot 193fcfb3-9670-4dbc-8c86-9f0b43068b6e of volume c2a7675d-1b69-45ee-99c4-9fe861c83f4c {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:19:05 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-6a6dee45-979f-46cc-a706-39feaa1a7f50 tempest-ProjectReaderTests-1438211366 None] snapshot_file for this snap is: volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c.193fcfb3-9670-4dbc-8c86-9f0b43068b6e {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:19:05 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45290d0-a692-44bb-acff-8a567a107559]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6a6dee45-979f-46cc-a706-39feaa1a7f50 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c.193fcfb3-9670-4dbc-8c86-9f0b43068b6e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:05 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c.193fcfb3-9670-4dbc-8c86-9f0b43068b6e Sep 01 02:19:05 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:05 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-34a76f7b-0c18-43c0-a2a7-a1de882b0a2e tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.258s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:05 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-34a76f7b-0c18-43c0-a2a7-a1de882b0a2e tempest-ProjectMemberTests-1927748625 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:05 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-34a76f7b-0c18-43c0-a2a7-a1de882b0a2e tempest-ProjectMemberTests-1927748625 None] Deleted volume successfully. Sep 01 02:19:05 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-34a76f7b-0c18-43c0-a2a7-a1de882b0a2e tempest-ProjectMemberTests-1927748625 None] Lock "cinder-4244a184-5f80-41c1-867c-9307cac3c671-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:05 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6a6dee45-979f-46cc-a706-39feaa1a7f50 tempest-ProjectReaderTests-1438211366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c.193fcfb3-9670-4dbc-8c86-9f0b43068b6e" returned: 0 in 0.374s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:05 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-6a6dee45-979f-46cc-a706-39feaa1a7f50 tempest-ProjectReaderTests-1438211366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:19:05 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[1715a99c-214c-4787-a493-15e74632a2ca]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:05 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6a6dee45-979f-46cc-a706-39feaa1a7f50 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:05 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c Sep 01 02:19:05 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] Flow 'volume_create_manager' (54e86913-5543-4fe7-b14d-0cb3ca79f93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7590de7c-6526-4470-8eba-1222425ac299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7590de7c-6526-4470-8eba-1222425ac299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2062188761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a840ec9-3d81-41bc-87c4-aaf36fc66df6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61578a8868584ca29ab081523d408c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:06Z,use_quota=True,user_id='f2911f91e5124a7ba8862f4b148bf6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc015279-1901-45ec-aee8-677c2736ac09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc015279-1901-45ec-aee8-677c2736ac09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1292b88-148e-4f41-a3ad-15756d2bfa9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1292b88-148e-4f41-a3ad-15756d2bfa9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a840ec9-3d81-41bc-87c4-aaf36fc66df6', 'volume_name': 'volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a23193-4cac-4c1f-982f-83eac1f50022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a23193-4cac-4c1f-982f-83eac1f50022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (580c39cf-7236-44af-b885-f09adbbc2e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:06 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] Volume 0a840ec9-3d81-41bc-87c4-aaf36fc66df6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6', 'volume_size': 1} Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2062188761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a840ec9-3d81-41bc-87c4-aaf36fc66df6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61578a8868584ca29ab081523d408c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:06Z,use_quota=True,user_id='f2911f91e5124a7ba8862f4b148bf6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] Creating volume 0a840ec9-3d81-41bc-87c4-aaf36fc66df6 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:19:06 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:06 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6 1073741824 Sep 01 02:19:06 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:06 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6a6dee45-979f-46cc-a706-39feaa1a7f50 tempest-ProjectReaderTests-1438211366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c" returned: 0 in 0.387s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6a6dee45-979f-46cc-a706-39feaa1a7f50 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c.193fcfb3-9670-4dbc-8c86-9f0b43068b6e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:06 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c.193fcfb3-9670-4dbc-8c86-9f0b43068b6e Sep 01 02:19:06 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:06 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6a6dee45-979f-46cc-a706-39feaa1a7f50 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c.193fcfb3-9670-4dbc-8c86-9f0b43068b6e" returned: 0 in 0.344s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6a6dee45-979f-46cc-a706-39feaa1a7f50 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c.193fcfb3-9670-4dbc-8c86-9f0b43068b6e {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:06 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:06 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c.193fcfb3-9670-4dbc-8c86-9f0b43068b6e Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6 1073741824" returned: 0 in 0.397s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:06 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:06 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6 Sep 01 02:19:06 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:06 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-6a6dee45-979f-46cc-a706-39feaa1a7f50 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c.193fcfb3-9670-4dbc-8c86-9f0b43068b6e" returned: 0 in 0.249s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6a6dee45-979f-46cc-a706-39feaa1a7f50 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-quobyte-193fcfb3-9670-4dbc-8c86-9f0b43068b6e" released by "_delete_snapshot" :: held 1.443s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6a6dee45-979f-46cc-a706-39feaa1a7f50 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-quobyte-c2a7675d-1b69-45ee-99c4-9fe861c83f4c" released by "delete_snapshot" :: held 1.466s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:06 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6" returned: 0 in 0.238s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (580c39cf-7236-44af-b885-f09adbbc2e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0976ad89-5fa7-4568-9514-dbc16c53c631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:06 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] Volume volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6 (0a840ec9-3d81-41bc-87c4-aaf36fc66df6): created successfully Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0976ad89-5fa7-4568-9514-dbc16c53c631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] Flow 'volume_create_manager' (54e86913-5543-4fe7-b14d-0cb3ca79f93c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:06 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-f2e732c3-97fb-4201-b365-9515846d166f tempest-ProjectMemberTests-1927748625 None] Created volume successfully. Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-6a6dee45-979f-46cc-a706-39feaa1a7f50 tempest-ProjectReaderTests-1438211366 None] Created reservations ['1aa30719-3902-40ae-9898-bc329bde18c2', '383896af-4b28-4a31-88dd-c7838577f177', '627dfcff-d455-4804-b4d8-53e8168bbb71', 'c71f3ab9-fd46-4a81-98a1-8e88e8e0a3eb'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:06 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-6a6dee45-979f-46cc-a706-39feaa1a7f50 tempest-ProjectReaderTests-1438211366 None] Delete snapshot completed successfully. Sep 01 02:19:06 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-6a6dee45-979f-46cc-a706-39feaa1a7f50 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-193fcfb3-9670-4dbc-8c86-9f0b43068b6e-delete_snapshot" released by "delete_snapshot" :: held 1.640s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b8a258b7-5cce-494b-9c18-b5dea30aa2fd tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b8a258b7-5cce-494b-9c18-b5dea30aa2fd tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:07 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-b8a258b7-5cce-494b-9c18-b5dea30aa2fd tempest-ProjectMemberTests-1927748625 None] Creating offline snapshot 2290c51b-2262-4d51-a217-38c7bd3a4579 of volume 0a840ec9-3d81-41bc-87c4-aaf36fc66df6 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:19:07 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[691b05a9-c405-4e4d-9dff-15c10e7e9269]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b8a258b7-5cce-494b-9c18-b5dea30aa2fd tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:07 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6 Sep 01 02:19:07 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:07 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7052f0bd-a80e-4a01-bd50-2174794c6fe2 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "cinder-c2a7675d-1b69-45ee-99c4-9fe861c83f4c-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:07 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7052f0bd-a80e-4a01-bd50-2174794c6fe2 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-c2a7675d-1b69-45ee-99c4-9fe861c83f4c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:07 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7052f0bd-a80e-4a01-bd50-2174794c6fe2 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "cinder-quobyte-c2a7675d-1b69-45ee-99c4-9fe861c83f4c" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:07 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7052f0bd-a80e-4a01-bd50-2174794c6fe2 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-quobyte-c2a7675d-1b69-45ee-99c4-9fe861c83f4c" acquired by "delete_volume" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:07 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[da32097a-1295-4a5b-a3a5-ebd89a19e7f3]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7052f0bd-a80e-4a01-bd50-2174794c6fe2 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:07 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b8a258b7-5cce-494b-9c18-b5dea30aa2fd tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6" returned: 0 in 0.381s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b8a258b7-5cce-494b-9c18-b5dea30aa2fd tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6.2290c51b-2262-4d51-a217-38c7bd3a4579 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:07 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6.2290c51b-2262-4d51-a217-38c7bd3a4579 1G Sep 01 02:19:07 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:07 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c Sep 01 02:19:07 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:07 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7052f0bd-a80e-4a01-bd50-2174794c6fe2 tempest-ProjectReaderTests-1438211366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c" returned: 0 in 0.391s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:07 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7052f0bd-a80e-4a01-bd50-2174794c6fe2 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:07 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c Sep 01 02:19:07 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:08 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b8a258b7-5cce-494b-9c18-b5dea30aa2fd tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6.2290c51b-2262-4d51-a217-38c7bd3a4579 1G" returned: 0 in 0.443s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b8a258b7-5cce-494b-9c18-b5dea30aa2fd tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6.2290c51b-2262-4d51-a217-38c7bd3a4579 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:08 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6.2290c51b-2262-4d51-a217-38c7bd3a4579 Sep 01 02:19:08 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:08 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7052f0bd-a80e-4a01-bd50-2174794c6fe2 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-c2a7675d-1b69-45ee-99c4-9fe861c83f4c" returned: 0 in 0.249s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:08 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7052f0bd-a80e-4a01-bd50-2174794c6fe2 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-quobyte-c2a7675d-1b69-45ee-99c4-9fe861c83f4c" released by "delete_volume" :: held 0.702s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:08 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-7052f0bd-a80e-4a01-bd50-2174794c6fe2 tempest-ProjectReaderTests-1438211366 None] Created reservations ['4e0dd4ec-7e01-48e1-887b-b07459ad5cd1', '18123fd4-690f-44b6-9b2e-25cc902f3e45', '2ec1d131-739c-4a04-8ee1-206f1f77aaff', 'c58d4e8c-a573-47ab-8adf-32582f244e87'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:08 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b8a258b7-5cce-494b-9c18-b5dea30aa2fd tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6.2290c51b-2262-4d51-a217-38c7bd3a4579" returned: 0 in 0.298s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:08 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-b8a258b7-5cce-494b-9c18-b5dea30aa2fd tempest-ProjectMemberTests-1927748625 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6.2290c51b-2262-4d51-a217-38c7bd3a4579 is being set with open permissions: ugo+rw Sep 01 02:19:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b8a258b7-5cce-494b-9c18-b5dea30aa2fd tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6.2290c51b-2262-4d51-a217-38c7bd3a4579 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:08 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6.2290c51b-2262-4d51-a217-38c7bd3a4579 Sep 01 02:19:08 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7052f0bd-a80e-4a01-bd50-2174794c6fe2 tempest-ProjectReaderTests-1438211366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7052f0bd-a80e-4a01-bd50-2174794c6fe2 tempest-ProjectReaderTests-1438211366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7052f0bd-a80e-4a01-bd50-2174794c6fe2 tempest-ProjectReaderTests-1438211366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:08 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-7052f0bd-a80e-4a01-bd50-2174794c6fe2 tempest-ProjectReaderTests-1438211366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-7052f0bd-a80e-4a01-bd50-2174794c6fe2 tempest-ProjectReaderTests-1438211366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7052f0bd-a80e-4a01-bd50-2174794c6fe2 tempest-ProjectReaderTests-1438211366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:08 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:19:08 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:08 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b8a258b7-5cce-494b-9c18-b5dea30aa2fd tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6.2290c51b-2262-4d51-a217-38c7bd3a4579" returned: 0 in 0.267s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:08 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-7052f0bd-a80e-4a01-bd50-2174794c6fe2 tempest-ProjectReaderTests-1438211366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.238s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:08 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-7052f0bd-a80e-4a01-bd50-2174794c6fe2 tempest-ProjectReaderTests-1438211366 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:08 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-7052f0bd-a80e-4a01-bd50-2174794c6fe2 tempest-ProjectReaderTests-1438211366 None] Deleted volume successfully. Sep 01 02:19:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b8a258b7-5cce-494b-9c18-b5dea30aa2fd tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:08 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-7052f0bd-a80e-4a01-bd50-2174794c6fe2 tempest-ProjectReaderTests-1438211366 None] Lock "cinder-c2a7675d-1b69-45ee-99c4-9fe861c83f4c-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:08 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6.info Sep 01 02:19:08 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:08 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b8a258b7-5cce-494b-9c18-b5dea30aa2fd tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6.info" returned: 0 in 0.261s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:08 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-b8a258b7-5cce-494b-9c18-b5dea30aa2fd tempest-ProjectMemberTests-1927748625 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6.info is being set with open permissions: ugo+rw Sep 01 02:19:08 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b8a258b7-5cce-494b-9c18-b5dea30aa2fd tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:08 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6.info Sep 01 02:19:08 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:09 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b8a258b7-5cce-494b-9c18-b5dea30aa2fd tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6.info" returned: 0 in 0.264s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:09 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b8a258b7-5cce-494b-9c18-b5dea30aa2fd tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:09 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-b8a258b7-5cce-494b-9c18-b5dea30aa2fd tempest-ProjectMemberTests-1927748625 None] Create snapshot completed successfully Sep 01 02:19:10 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2bb0974d-ecd5-417f-a97c-c5755c4f8779 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-2290c51b-2262-4d51-a217-38c7bd3a4579-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:10 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2bb0974d-ecd5-417f-a97c-c5755c4f8779 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-2290c51b-2262-4d51-a217-38c7bd3a4579-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:10 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2bb0974d-ecd5-417f-a97c-c5755c4f8779 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-quobyte-0a840ec9-3d81-41bc-87c4-aaf36fc66df6" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:10 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2bb0974d-ecd5-417f-a97c-c5755c4f8779 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-0a840ec9-3d81-41bc-87c4-aaf36fc66df6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:10 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2bb0974d-ecd5-417f-a97c-c5755c4f8779 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-quobyte-2290c51b-2262-4d51-a217-38c7bd3a4579" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:10 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2bb0974d-ecd5-417f-a97c-c5755c4f8779 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-2290c51b-2262-4d51-a217-38c7bd3a4579" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:10 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-2bb0974d-ecd5-417f-a97c-c5755c4f8779 tempest-ProjectMemberTests-1927748625 None] Deleting offline snapshot 2290c51b-2262-4d51-a217-38c7bd3a4579 of volume 0a840ec9-3d81-41bc-87c4-aaf36fc66df6 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:19:10 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-2bb0974d-ecd5-417f-a97c-c5755c4f8779 tempest-ProjectMemberTests-1927748625 None] snapshot_file for this snap is: volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6.2290c51b-2262-4d51-a217-38c7bd3a4579 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:19:10 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72fea0b-dd79-4174-8ef5-3d1240c62ca2]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2bb0974d-ecd5-417f-a97c-c5755c4f8779 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6.2290c51b-2262-4d51-a217-38c7bd3a4579 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:10 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6.2290c51b-2262-4d51-a217-38c7bd3a4579 Sep 01 02:19:10 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:10 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2bb0974d-ecd5-417f-a97c-c5755c4f8779 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6.2290c51b-2262-4d51-a217-38c7bd3a4579" returned: 0 in 0.391s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:10 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-2bb0974d-ecd5-417f-a97c-c5755c4f8779 tempest-ProjectMemberTests-1927748625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:19:10 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff9974d-d7a5-4ba5-bd73-804a571f13c6]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:10 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2bb0974d-ecd5-417f-a97c-c5755c4f8779 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:10 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6 Sep 01 02:19:10 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:11 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2bb0974d-ecd5-417f-a97c-c5755c4f8779 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6" returned: 0 in 0.349s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2bb0974d-ecd5-417f-a97c-c5755c4f8779 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6.2290c51b-2262-4d51-a217-38c7bd3a4579 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:11 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6.2290c51b-2262-4d51-a217-38c7bd3a4579 Sep 01 02:19:11 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:11 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2bb0974d-ecd5-417f-a97c-c5755c4f8779 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6.2290c51b-2262-4d51-a217-38c7bd3a4579" returned: 0 in 0.349s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2bb0974d-ecd5-417f-a97c-c5755c4f8779 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6.2290c51b-2262-4d51-a217-38c7bd3a4579 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:11 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6.2290c51b-2262-4d51-a217-38c7bd3a4579 Sep 01 02:19:11 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:11 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:11 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-2bb0974d-ecd5-417f-a97c-c5755c4f8779 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6.2290c51b-2262-4d51-a217-38c7bd3a4579" returned: 0 in 0.248s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2bb0974d-ecd5-417f-a97c-c5755c4f8779 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-2290c51b-2262-4d51-a217-38c7bd3a4579" released by "_delete_snapshot" :: held 1.449s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2bb0974d-ecd5-417f-a97c-c5755c4f8779 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-0a840ec9-3d81-41bc-87c4-aaf36fc66df6" released by "delete_snapshot" :: held 1.478s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:11 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-2bb0974d-ecd5-417f-a97c-c5755c4f8779 tempest-ProjectMemberTests-1927748625 None] Created reservations ['ac9f9cd2-983e-4019-bad5-1a93481445dc', '3e32c466-ea67-4e5e-8459-4cc9c32df51b', '697e6714-45c2-4e98-9be7-f1a9b6d01ffd', 'e8e55b64-10b6-4f26-a72c-fabbf84110f9'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:11 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-2bb0974d-ecd5-417f-a97c-c5755c4f8779 tempest-ProjectMemberTests-1927748625 None] Delete snapshot completed successfully. Sep 01 02:19:11 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-2bb0974d-ecd5-417f-a97c-c5755c4f8779 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-2290c51b-2262-4d51-a217-38c7bd3a4579-delete_snapshot" released by "delete_snapshot" :: held 1.622s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:12 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-79eed903-e34d-4410-9dc3-1b1716857567 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-0a840ec9-3d81-41bc-87c4-aaf36fc66df6-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:12 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-79eed903-e34d-4410-9dc3-1b1716857567 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-0a840ec9-3d81-41bc-87c4-aaf36fc66df6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:12 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-79eed903-e34d-4410-9dc3-1b1716857567 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-quobyte-0a840ec9-3d81-41bc-87c4-aaf36fc66df6" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:12 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-79eed903-e34d-4410-9dc3-1b1716857567 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-0a840ec9-3d81-41bc-87c4-aaf36fc66df6" acquired by "delete_volume" :: waited 0.021s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:12 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[99664202-fafd-4640-a447-9c797eb3d3c6]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-79eed903-e34d-4410-9dc3-1b1716857567 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:12 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6 Sep 01 02:19:12 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:12 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:12 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-79eed903-e34d-4410-9dc3-1b1716857567 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6" returned: 0 in 0.380s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-79eed903-e34d-4410-9dc3-1b1716857567 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:13 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6 Sep 01 02:19:13 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:13 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-79eed903-e34d-4410-9dc3-1b1716857567 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-0a840ec9-3d81-41bc-87c4-aaf36fc66df6" returned: 0 in 0.263s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:13 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-79eed903-e34d-4410-9dc3-1b1716857567 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-0a840ec9-3d81-41bc-87c4-aaf36fc66df6" released by "delete_volume" :: held 0.708s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:13 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-79eed903-e34d-4410-9dc3-1b1716857567 tempest-ProjectMemberTests-1927748625 None] Created reservations ['2cefd4d0-a3f6-4837-8b30-7697c4ac9148', '4d6088a5-2f4a-4ffb-b2c5-8157002fd56e', '9ea567a0-c865-4a6f-959c-8cd9b88f302a', '4ebd7f66-53a7-4bc5-9cb7-0e4f55085ab1'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-79eed903-e34d-4410-9dc3-1b1716857567 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-79eed903-e34d-4410-9dc3-1b1716857567 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:13 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-79eed903-e34d-4410-9dc3-1b1716857567 tempest-ProjectMemberTests-1927748625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:13 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-79eed903-e34d-4410-9dc3-1b1716857567 tempest-ProjectMemberTests-1927748625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-79eed903-e34d-4410-9dc3-1b1716857567 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-79eed903-e34d-4410-9dc3-1b1716857567 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:13 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:19:13 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:13 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:13 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-79eed903-e34d-4410-9dc3-1b1716857567 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.296s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:13 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-79eed903-e34d-4410-9dc3-1b1716857567 tempest-ProjectMemberTests-1927748625 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:13 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-79eed903-e34d-4410-9dc3-1b1716857567 tempest-ProjectMemberTests-1927748625 None] Deleted volume successfully. Sep 01 02:19:13 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-79eed903-e34d-4410-9dc3-1b1716857567 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-0a840ec9-3d81-41bc-87c4-aaf36fc66df6-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:UPDATE=257,cinder:SELECT=200,cinder:INSERT=77,cinder:DELETE=20 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] Flow 'volume_create_manager' (6373ba09-a462-4e46-ac85-1d05f7189b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61e957a3-e643-459d-9cb9-04dc2ad12e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61e957a3-e643-459d-9cb9-04dc2ad12e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-340909987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd30f360-c51a-4900-9eb5-f0b71be91419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61578a8868584ca29ab081523d408c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:14Z,use_quota=True,user_id='f2911f91e5124a7ba8862f4b148bf6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (417d5bee-dcee-428b-a201-d8299d5811f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (417d5bee-dcee-428b-a201-d8299d5811f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67bc8022-6d43-491f-9176-cdc704e4da9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67bc8022-6d43-491f-9176-cdc704e4da9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd30f360-c51a-4900-9eb5-f0b71be91419', 'volume_name': 'volume-fd30f360-c51a-4900-9eb5-f0b71be91419', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b830a85a-34e3-4384-96c2-6a5567b4a2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b830a85a-34e3-4384-96c2-6a5567b4a2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bcf0dac-7702-48e1-b864-1e0227705803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:14 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] Volume fd30f360-c51a-4900-9eb5-f0b71be91419: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd30f360-c51a-4900-9eb5-f0b71be91419', 'volume_size': 1} Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-340909987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd30f360-c51a-4900-9eb5-f0b71be91419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61578a8868584ca29ab081523d408c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:14Z,use_quota=True,user_id='f2911f91e5124a7ba8862f4b148bf6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] Creating volume fd30f360-c51a-4900-9eb5-f0b71be91419 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:19:14 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:14 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419 1073741824 Sep 01 02:19:14 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:14 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419 1073741824" returned: 0 in 0.390s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:UPDATE=273,cinder:SELECT=210,cinder:INSERT=73,cinder:DELETE=23 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:14 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419 Sep 01 02:19:14 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:14 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419" returned: 0 in 0.269s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bcf0dac-7702-48e1-b864-1e0227705803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd30f360-c51a-4900-9eb5-f0b71be91419', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ebc3b9-9534-41bc-8ca8-9d2078afd48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:14 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] Volume volume-fd30f360-c51a-4900-9eb5-f0b71be91419 (fd30f360-c51a-4900-9eb5-f0b71be91419): created successfully Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ebc3b9-9534-41bc-8ca8-9d2078afd48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:14 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] Flow 'volume_create_manager' (6373ba09-a462-4e46-ac85-1d05f7189b38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:14 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-d4a3a48f-cb41-42c3-8a5a-b3841f0086a4 tempest-ProjectMemberTests-1927748625 None] Created volume successfully. Sep 01 02:19:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b3f57d11-0aca-47ea-8882-f8f34819a2e5 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b3f57d11-0aca-47ea-8882-f8f34819a2e5 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:15 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-b3f57d11-0aca-47ea-8882-f8f34819a2e5 tempest-ProjectMemberTests-1927748625 None] Creating offline snapshot 09e3942a-f3a2-45dd-b259-322f6376043d of volume fd30f360-c51a-4900-9eb5-f0b71be91419 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:19:15 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd84b831-bf3f-4a3e-8e7d-2b2f3d422f8d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b3f57d11-0aca-47ea-8882-f8f34819a2e5 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:15 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419 Sep 01 02:19:15 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:15 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b3f57d11-0aca-47ea-8882-f8f34819a2e5 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419" returned: 0 in 0.378s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:15 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b3f57d11-0aca-47ea-8882-f8f34819a2e5 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419.09e3942a-f3a2-45dd-b259-322f6376043d 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:15 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419.09e3942a-f3a2-45dd-b259-322f6376043d 1G Sep 01 02:19:15 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:16 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b3f57d11-0aca-47ea-8882-f8f34819a2e5 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419.09e3942a-f3a2-45dd-b259-322f6376043d 1G" returned: 0 in 0.373s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b3f57d11-0aca-47ea-8882-f8f34819a2e5 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd30f360-c51a-4900-9eb5-f0b71be91419 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419.09e3942a-f3a2-45dd-b259-322f6376043d {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:16 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd30f360-c51a-4900-9eb5-f0b71be91419 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419.09e3942a-f3a2-45dd-b259-322f6376043d Sep 01 02:19:16 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:16 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b3f57d11-0aca-47ea-8882-f8f34819a2e5 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd30f360-c51a-4900-9eb5-f0b71be91419 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419.09e3942a-f3a2-45dd-b259-322f6376043d" returned: 0 in 0.267s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:16 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-b3f57d11-0aca-47ea-8882-f8f34819a2e5 tempest-ProjectMemberTests-1927748625 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419.09e3942a-f3a2-45dd-b259-322f6376043d is being set with open permissions: ugo+rw Sep 01 02:19:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b3f57d11-0aca-47ea-8882-f8f34819a2e5 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419.09e3942a-f3a2-45dd-b259-322f6376043d {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:16 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419.09e3942a-f3a2-45dd-b259-322f6376043d Sep 01 02:19:16 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:16 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b3f57d11-0aca-47ea-8882-f8f34819a2e5 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419.09e3942a-f3a2-45dd-b259-322f6376043d" returned: 0 in 0.225s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b3f57d11-0aca-47ea-8882-f8f34819a2e5 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:16 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419.info Sep 01 02:19:16 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:16 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b3f57d11-0aca-47ea-8882-f8f34819a2e5 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419.info" returned: 0 in 0.255s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:16 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-b3f57d11-0aca-47ea-8882-f8f34819a2e5 tempest-ProjectMemberTests-1927748625 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419.info is being set with open permissions: ugo+rw Sep 01 02:19:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b3f57d11-0aca-47ea-8882-f8f34819a2e5 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:16 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419.info Sep 01 02:19:16 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:16 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:19:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:17 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:19:17 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:17 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b3f57d11-0aca-47ea-8882-f8f34819a2e5 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419.info" returned: 0 in 0.303s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b3f57d11-0aca-47ea-8882-f8f34819a2e5 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.889s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:17 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.273s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:17 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:17 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-b3f57d11-0aca-47ea-8882-f8f34819a2e5 tempest-ProjectMemberTests-1927748625 None] Create snapshot completed successfully Sep 01 02:19:17 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager._thread_info {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:19:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread count: 29 {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:19:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread info: [<_MainThread(MainThread, started 128688016527488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:19:17 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-dd12216e-2b70-4791-b51d-bdda15efe903 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-09e3942a-f3a2-45dd-b259-322f6376043d-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:17 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-dd12216e-2b70-4791-b51d-bdda15efe903 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-09e3942a-f3a2-45dd-b259-322f6376043d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:17 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-dd12216e-2b70-4791-b51d-bdda15efe903 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-quobyte-fd30f360-c51a-4900-9eb5-f0b71be91419" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:17 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-dd12216e-2b70-4791-b51d-bdda15efe903 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-fd30f360-c51a-4900-9eb5-f0b71be91419" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:17 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-dd12216e-2b70-4791-b51d-bdda15efe903 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-quobyte-09e3942a-f3a2-45dd-b259-322f6376043d" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:17 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-dd12216e-2b70-4791-b51d-bdda15efe903 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-09e3942a-f3a2-45dd-b259-322f6376043d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-dd12216e-2b70-4791-b51d-bdda15efe903 tempest-ProjectMemberTests-1927748625 None] Deleting offline snapshot 09e3942a-f3a2-45dd-b259-322f6376043d of volume fd30f360-c51a-4900-9eb5-f0b71be91419 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:19:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-dd12216e-2b70-4791-b51d-bdda15efe903 tempest-ProjectMemberTests-1927748625 None] snapshot_file for this snap is: volume-fd30f360-c51a-4900-9eb5-f0b71be91419.09e3942a-f3a2-45dd-b259-322f6376043d {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:19:17 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[24de9d64-3031-42ea-8a2c-b93f1d1c8d34]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-dd12216e-2b70-4791-b51d-bdda15efe903 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419.09e3942a-f3a2-45dd-b259-322f6376043d {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:17 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419.09e3942a-f3a2-45dd-b259-322f6376043d Sep 01 02:19:17 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:17 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-dd12216e-2b70-4791-b51d-bdda15efe903 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419.09e3942a-f3a2-45dd-b259-322f6376043d" returned: 0 in 0.424s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:17 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-dd12216e-2b70-4791-b51d-bdda15efe903 tempest-ProjectMemberTests-1927748625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd30f360-c51a-4900-9eb5-f0b71be91419(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:19:18 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5850140-b3e4-4913-8eb6-4b4049c41ccf]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-dd12216e-2b70-4791-b51d-bdda15efe903 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:18 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419 Sep 01 02:19:18 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:18 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-dd12216e-2b70-4791-b51d-bdda15efe903 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419" returned: 0 in 0.401s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-dd12216e-2b70-4791-b51d-bdda15efe903 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419.09e3942a-f3a2-45dd-b259-322f6376043d {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:18 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419.09e3942a-f3a2-45dd-b259-322f6376043d Sep 01 02:19:18 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:18 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-dd12216e-2b70-4791-b51d-bdda15efe903 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419.09e3942a-f3a2-45dd-b259-322f6376043d" returned: 0 in 0.339s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:18 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-dd12216e-2b70-4791-b51d-bdda15efe903 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419.09e3942a-f3a2-45dd-b259-322f6376043d {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:18 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419.09e3942a-f3a2-45dd-b259-322f6376043d Sep 01 02:19:18 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:19 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-dd12216e-2b70-4791-b51d-bdda15efe903 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419.09e3942a-f3a2-45dd-b259-322f6376043d" returned: 0 in 0.261s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-dd12216e-2b70-4791-b51d-bdda15efe903 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-09e3942a-f3a2-45dd-b259-322f6376043d" released by "_delete_snapshot" :: held 1.524s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-dd12216e-2b70-4791-b51d-bdda15efe903 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-fd30f360-c51a-4900-9eb5-f0b71be91419" released by "delete_snapshot" :: held 1.548s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:19 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-dd12216e-2b70-4791-b51d-bdda15efe903 tempest-ProjectMemberTests-1927748625 None] Created reservations ['cd62ff09-4100-49de-bcdc-23f1f6f1722e', '8063d85f-6675-449c-8b3c-81193fd09676', 'cf24c164-bd67-4019-98a0-e12ac5dcebc9', '233c76ec-3920-4820-aac0-22a68f6ef674'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:19 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-dd12216e-2b70-4791-b51d-bdda15efe903 tempest-ProjectMemberTests-1927748625 None] Delete snapshot completed successfully. Sep 01 02:19:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-dd12216e-2b70-4791-b51d-bdda15efe903 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-09e3942a-f3a2-45dd-b259-322f6376043d-delete_snapshot" released by "delete_snapshot" :: held 1.722s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e087bd75-a7cf-4123-8a20-ddc9292f2ad4 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-fd30f360-c51a-4900-9eb5-f0b71be91419-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e087bd75-a7cf-4123-8a20-ddc9292f2ad4 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-fd30f360-c51a-4900-9eb5-f0b71be91419-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e087bd75-a7cf-4123-8a20-ddc9292f2ad4 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-quobyte-fd30f360-c51a-4900-9eb5-f0b71be91419" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:19 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e087bd75-a7cf-4123-8a20-ddc9292f2ad4 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-fd30f360-c51a-4900-9eb5-f0b71be91419" acquired by "delete_volume" :: waited 0.024s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:19 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2746cd-7f46-4e67-b919-74d2031757e7]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:19 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e087bd75-a7cf-4123-8a20-ddc9292f2ad4 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:19 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419 Sep 01 02:19:19 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:20 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e087bd75-a7cf-4123-8a20-ddc9292f2ad4 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419" returned: 0 in 0.373s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e087bd75-a7cf-4123-8a20-ddc9292f2ad4 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:20 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419 Sep 01 02:19:20 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:20 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e087bd75-a7cf-4123-8a20-ddc9292f2ad4 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd30f360-c51a-4900-9eb5-f0b71be91419" returned: 0 in 0.268s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:20 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e087bd75-a7cf-4123-8a20-ddc9292f2ad4 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-fd30f360-c51a-4900-9eb5-f0b71be91419" released by "delete_volume" :: held 0.700s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:20 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-e087bd75-a7cf-4123-8a20-ddc9292f2ad4 tempest-ProjectMemberTests-1927748625 None] Created reservations ['599ebbb9-328a-4dbb-9a44-54b8756a59a4', '7064f74b-2666-4a5b-9f5f-ee4d92d77789', '8c56edbb-c6db-4eee-bde6-4c534d8ef897', '1182539a-aa39-44a1-aeda-38f4f4522cca'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e087bd75-a7cf-4123-8a20-ddc9292f2ad4 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e087bd75-a7cf-4123-8a20-ddc9292f2ad4 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:20 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e087bd75-a7cf-4123-8a20-ddc9292f2ad4 tempest-ProjectMemberTests-1927748625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:20 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-e087bd75-a7cf-4123-8a20-ddc9292f2ad4 tempest-ProjectMemberTests-1927748625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-e087bd75-a7cf-4123-8a20-ddc9292f2ad4 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e087bd75-a7cf-4123-8a20-ddc9292f2ad4 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:20 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:19:20 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:20 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:20 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-e087bd75-a7cf-4123-8a20-ddc9292f2ad4 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.313s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:20 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-e087bd75-a7cf-4123-8a20-ddc9292f2ad4 tempest-ProjectMemberTests-1927748625 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:20 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-e087bd75-a7cf-4123-8a20-ddc9292f2ad4 tempest-ProjectMemberTests-1927748625 None] Deleted volume successfully. Sep 01 02:19:20 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-e087bd75-a7cf-4123-8a20-ddc9292f2ad4 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-fd30f360-c51a-4900-9eb5-f0b71be91419-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:21 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:19:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] Flow 'volume_create_manager' (bef2ffdb-c8c3-4d3c-942e-c22baf313b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7e0c81-9bbe-4302-89ba-c02bb8cacb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7e0c81-9bbe-4302-89ba-c02bb8cacb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1544710880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78e5725d-2e99-4fd2-8022-c1bba13560e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61578a8868584ca29ab081523d408c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:21Z,use_quota=True,user_id='f2911f91e5124a7ba8862f4b148bf6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e7e64b-9206-4c3a-91bc-2020fe17b1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e7e64b-9206-4c3a-91bc-2020fe17b1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c237fa76-b433-49a9-91c9-96289431917f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c237fa76-b433-49a9-91c9-96289431917f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78e5725d-2e99-4fd2-8022-c1bba13560e4', 'volume_name': 'volume-78e5725d-2e99-4fd2-8022-c1bba13560e4', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e3c8111-2ff5-403d-b824-72bc53c533f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e3c8111-2ff5-403d-b824-72bc53c533f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:21 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19fab930-5224-48d7-87d4-dccf8d75177e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:21 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] Volume 78e5725d-2e99-4fd2-8022-c1bba13560e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78e5725d-2e99-4fd2-8022-c1bba13560e4', 'volume_size': 1} Sep 01 02:19:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1544710880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78e5725d-2e99-4fd2-8022-c1bba13560e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61578a8868584ca29ab081523d408c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:21Z,use_quota=True,user_id='f2911f91e5124a7ba8862f4b148bf6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:19:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] Creating volume 78e5725d-2e99-4fd2-8022-c1bba13560e4 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:19:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:21 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:19:21 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:19:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:21 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4 1073741824 Sep 01 02:19:21 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:21 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4 1073741824" returned: 0 in 0.420s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:21 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4 Sep 01 02:19:21 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:22 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4" returned: 0 in 0.259s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:22 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:19:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:22 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19fab930-5224-48d7-87d4-dccf8d75177e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78e5725d-2e99-4fd2-8022-c1bba13560e4', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:22 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a90f2a6d-5a8b-4d28-9601-87dbef1fedda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:22 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] Volume volume-78e5725d-2e99-4fd2-8022-c1bba13560e4 (78e5725d-2e99-4fd2-8022-c1bba13560e4): created successfully Sep 01 02:19:22 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a90f2a6d-5a8b-4d28-9601-87dbef1fedda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:22 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] Flow 'volume_create_manager' (bef2ffdb-c8c3-4d3c-942e-c22baf313b06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:22 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-b5313a8b-572f-4ab4-be44-c11e7596df55 tempest-ProjectMemberTests-1927748625 None] Created volume successfully. Sep 01 02:19:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8af7d00f-9e3b-4255-80c9-70553689d716 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8af7d00f-9e3b-4255-80c9-70553689d716 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:22 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-8af7d00f-9e3b-4255-80c9-70553689d716 tempest-ProjectMemberTests-1927748625 None] Creating offline snapshot 17eb91a9-ac25-4dce-bd0e-0c7737c4e1f0 of volume 78e5725d-2e99-4fd2-8022-c1bba13560e4 {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:19:22 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c46700-33f6-4a0c-813d-68f3545f16e0]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:22 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8af7d00f-9e3b-4255-80c9-70553689d716 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:22 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4 Sep 01 02:19:22 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:23 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8af7d00f-9e3b-4255-80c9-70553689d716 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4" returned: 0 in 0.413s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8af7d00f-9e3b-4255-80c9-70553689d716 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4.17eb91a9-ac25-4dce-bd0e-0c7737c4e1f0 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:23 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4.17eb91a9-ac25-4dce-bd0e-0c7737c4e1f0 1G Sep 01 02:19:23 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:23 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8af7d00f-9e3b-4255-80c9-70553689d716 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4.17eb91a9-ac25-4dce-bd0e-0c7737c4e1f0 1G" returned: 0 in 0.409s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8af7d00f-9e3b-4255-80c9-70553689d716 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78e5725d-2e99-4fd2-8022-c1bba13560e4 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4.17eb91a9-ac25-4dce-bd0e-0c7737c4e1f0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:23 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78e5725d-2e99-4fd2-8022-c1bba13560e4 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4.17eb91a9-ac25-4dce-bd0e-0c7737c4e1f0 Sep 01 02:19:23 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:23 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8af7d00f-9e3b-4255-80c9-70553689d716 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78e5725d-2e99-4fd2-8022-c1bba13560e4 -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4.17eb91a9-ac25-4dce-bd0e-0c7737c4e1f0" returned: 0 in 0.310s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:23 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-8af7d00f-9e3b-4255-80c9-70553689d716 tempest-ProjectMemberTests-1927748625 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4.17eb91a9-ac25-4dce-bd0e-0c7737c4e1f0 is being set with open permissions: ugo+rw Sep 01 02:19:23 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8af7d00f-9e3b-4255-80c9-70553689d716 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4.17eb91a9-ac25-4dce-bd0e-0c7737c4e1f0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:23 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4.17eb91a9-ac25-4dce-bd0e-0c7737c4e1f0 Sep 01 02:19:23 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:24 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8af7d00f-9e3b-4255-80c9-70553689d716 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4.17eb91a9-ac25-4dce-bd0e-0c7737c4e1f0" returned: 0 in 0.260s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8af7d00f-9e3b-4255-80c9-70553689d716 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:24 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4.info Sep 01 02:19:24 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:24 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8af7d00f-9e3b-4255-80c9-70553689d716 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4.info" returned: 0 in 0.275s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:24 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-8af7d00f-9e3b-4255-80c9-70553689d716 tempest-ProjectMemberTests-1927748625 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4.info is being set with open permissions: ugo+rw Sep 01 02:19:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8af7d00f-9e3b-4255-80c9-70553689d716 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:24 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4.info Sep 01 02:19:24 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:24 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-8af7d00f-9e3b-4255-80c9-70553689d716 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4.info" returned: 0 in 0.240s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:24 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-8af7d00f-9e3b-4255-80c9-70553689d716 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.021s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:24 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-8af7d00f-9e3b-4255-80c9-70553689d716 tempest-ProjectMemberTests-1927748625 None] Create snapshot completed successfully Sep 01 02:19:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5c3bba8f-eb6a-4a55-8885-3642d9902e24 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-17eb91a9-ac25-4dce-bd0e-0c7737c4e1f0-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5c3bba8f-eb6a-4a55-8885-3642d9902e24 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-17eb91a9-ac25-4dce-bd0e-0c7737c4e1f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5c3bba8f-eb6a-4a55-8885-3642d9902e24 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-quobyte-78e5725d-2e99-4fd2-8022-c1bba13560e4" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5c3bba8f-eb6a-4a55-8885-3642d9902e24 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-78e5725d-2e99-4fd2-8022-c1bba13560e4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5c3bba8f-eb6a-4a55-8885-3642d9902e24 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-quobyte-17eb91a9-ac25-4dce-bd0e-0c7737c4e1f0" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:25 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5c3bba8f-eb6a-4a55-8885-3642d9902e24 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-17eb91a9-ac25-4dce-bd0e-0c7737c4e1f0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-5c3bba8f-eb6a-4a55-8885-3642d9902e24 tempest-ProjectMemberTests-1927748625 None] Deleting offline snapshot 17eb91a9-ac25-4dce-bd0e-0c7737c4e1f0 of volume 78e5725d-2e99-4fd2-8022-c1bba13560e4 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:19:25 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-5c3bba8f-eb6a-4a55-8885-3642d9902e24 tempest-ProjectMemberTests-1927748625 None] snapshot_file for this snap is: volume-78e5725d-2e99-4fd2-8022-c1bba13560e4.17eb91a9-ac25-4dce-bd0e-0c7737c4e1f0 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:19:25 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2b7afd-878e-42b6-8a99-d35ae5eece2f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:25 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5c3bba8f-eb6a-4a55-8885-3642d9902e24 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4.17eb91a9-ac25-4dce-bd0e-0c7737c4e1f0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:25 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4.17eb91a9-ac25-4dce-bd0e-0c7737c4e1f0 Sep 01 02:19:25 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:26 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5c3bba8f-eb6a-4a55-8885-3642d9902e24 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4.17eb91a9-ac25-4dce-bd0e-0c7737c4e1f0" returned: 0 in 0.358s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:26 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-5c3bba8f-eb6a-4a55-8885-3642d9902e24 tempest-ProjectMemberTests-1927748625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78e5725d-2e99-4fd2-8022-c1bba13560e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:19:26 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b56a52-e750-4ddd-a1bd-d4fcd53705a9]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5c3bba8f-eb6a-4a55-8885-3642d9902e24 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:26 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4 Sep 01 02:19:26 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:26 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5c3bba8f-eb6a-4a55-8885-3642d9902e24 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4" returned: 0 in 0.376s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5c3bba8f-eb6a-4a55-8885-3642d9902e24 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4.17eb91a9-ac25-4dce-bd0e-0c7737c4e1f0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:26 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4.17eb91a9-ac25-4dce-bd0e-0c7737c4e1f0 Sep 01 02:19:26 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:26 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5c3bba8f-eb6a-4a55-8885-3642d9902e24 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4.17eb91a9-ac25-4dce-bd0e-0c7737c4e1f0" returned: 0 in 0.329s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:26 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5c3bba8f-eb6a-4a55-8885-3642d9902e24 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4.17eb91a9-ac25-4dce-bd0e-0c7737c4e1f0 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:26 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4.17eb91a9-ac25-4dce-bd0e-0c7737c4e1f0 Sep 01 02:19:26 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:27 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:27 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-5c3bba8f-eb6a-4a55-8885-3642d9902e24 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4.17eb91a9-ac25-4dce-bd0e-0c7737c4e1f0" returned: 0 in 0.238s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:27 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5c3bba8f-eb6a-4a55-8885-3642d9902e24 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-17eb91a9-ac25-4dce-bd0e-0c7737c4e1f0" released by "_delete_snapshot" :: held 1.404s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:27 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5c3bba8f-eb6a-4a55-8885-3642d9902e24 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-78e5725d-2e99-4fd2-8022-c1bba13560e4" released by "delete_snapshot" :: held 1.431s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:27 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-5c3bba8f-eb6a-4a55-8885-3642d9902e24 tempest-ProjectMemberTests-1927748625 None] Created reservations ['c9ac2892-396d-4f7c-b26f-c5a7f0cbccdc', 'daa0fb48-d25d-4647-a701-8a869f68824a', 'aecdf675-0e61-4c15-8686-08acd4d713ae', '3a78a89f-f8b0-4a66-a44e-9ff1b5ac1470'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:27 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-5c3bba8f-eb6a-4a55-8885-3642d9902e24 tempest-ProjectMemberTests-1927748625 None] Delete snapshot completed successfully. Sep 01 02:19:27 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-5c3bba8f-eb6a-4a55-8885-3642d9902e24 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-17eb91a9-ac25-4dce-bd0e-0c7737c4e1f0-delete_snapshot" released by "delete_snapshot" :: held 1.587s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:27 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-346506c0-40b3-41ba-b40f-46f558b90f01 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-78e5725d-2e99-4fd2-8022-c1bba13560e4-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:27 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-346506c0-40b3-41ba-b40f-46f558b90f01 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-78e5725d-2e99-4fd2-8022-c1bba13560e4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:27 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-346506c0-40b3-41ba-b40f-46f558b90f01 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-quobyte-78e5725d-2e99-4fd2-8022-c1bba13560e4" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:28 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-346506c0-40b3-41ba-b40f-46f558b90f01 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-78e5725d-2e99-4fd2-8022-c1bba13560e4" acquired by "delete_volume" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:28 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[51861391-8ae6-45c7-a124-558967af995f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-346506c0-40b3-41ba-b40f-46f558b90f01 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:28 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4 Sep 01 02:19:28 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:28 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-346506c0-40b3-41ba-b40f-46f558b90f01 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4" returned: 0 in 0.357s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-346506c0-40b3-41ba-b40f-46f558b90f01 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:28 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4 Sep 01 02:19:28 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:28 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-346506c0-40b3-41ba-b40f-46f558b90f01 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-78e5725d-2e99-4fd2-8022-c1bba13560e4" returned: 0 in 0.229s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:28 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-346506c0-40b3-41ba-b40f-46f558b90f01 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-78e5725d-2e99-4fd2-8022-c1bba13560e4" released by "delete_volume" :: held 0.640s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:28 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-346506c0-40b3-41ba-b40f-46f558b90f01 tempest-ProjectMemberTests-1927748625 None] Created reservations ['c291a67d-26c9-46a6-a703-7a2fa3334044', '5972691d-a663-4171-9668-e12957839cfd', '7047be1c-dc46-4452-a2dd-a369462c171d', '56706dcb-17c5-4839-88d0-1b9109adee84'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-346506c0-40b3-41ba-b40f-46f558b90f01 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-346506c0-40b3-41ba-b40f-46f558b90f01 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:28 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-346506c0-40b3-41ba-b40f-46f558b90f01 tempest-ProjectMemberTests-1927748625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:28 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-346506c0-40b3-41ba-b40f-46f558b90f01 tempest-ProjectMemberTests-1927748625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-346506c0-40b3-41ba-b40f-46f558b90f01 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:28 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-346506c0-40b3-41ba-b40f-46f558b90f01 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:28 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:19:28 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:29 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-346506c0-40b3-41ba-b40f-46f558b90f01 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.243s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:29 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-346506c0-40b3-41ba-b40f-46f558b90f01 tempest-ProjectMemberTests-1927748625 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:29 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-346506c0-40b3-41ba-b40f-46f558b90f01 tempest-ProjectMemberTests-1927748625 None] Deleted volume successfully. Sep 01 02:19:29 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-346506c0-40b3-41ba-b40f-46f558b90f01 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-78e5725d-2e99-4fd2-8022-c1bba13560e4-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:29 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:19:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] Flow 'volume_create_manager' (4d9d7cb5-6f67-4325-b712-829883a03292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (053a3bc0-556a-41f8-b540-0492e800387b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (053a3bc0-556a-41f8-b540-0492e800387b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-896715665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=733b5c84-d1a6-4bb9-88a8-99b7f8a7136b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61578a8868584ca29ab081523d408c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:29Z,use_quota=True,user_id='f2911f91e5124a7ba8862f4b148bf6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30d79fa7-33a5-49d5-87df-d697d701c420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30d79fa7-33a5-49d5-87df-d697d701c420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a1e137-7f3c-4e35-b731-373b6fae55f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a1e137-7f3c-4e35-b731-373b6fae55f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '733b5c84-d1a6-4bb9-88a8-99b7f8a7136b', 'volume_name': 'volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd0a5d0e-49e2-4345-8a84-38fbbc741b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd0a5d0e-49e2-4345-8a84-38fbbc741b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:29 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2107cd5e-9b16-4184-9bb7-b18a7cafadbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:29 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] Volume 733b5c84-d1a6-4bb9-88a8-99b7f8a7136b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b', 'volume_size': 1} Sep 01 02:19:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:29 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-896715665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=733b5c84-d1a6-4bb9-88a8-99b7f8a7136b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61578a8868584ca29ab081523d408c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:29Z,use_quota=True,user_id='f2911f91e5124a7ba8862f4b148bf6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:19:29 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] Creating volume 733b5c84-d1a6-4bb9-88a8-99b7f8a7136b {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:19:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:29 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:29 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:29 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:19:29 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:19:29 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:29 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b 1073741824 Sep 01 02:19:29 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:30 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b 1073741824" returned: 0 in 0.435s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:30 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b Sep 01 02:19:30 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:30 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b" returned: 0 in 0.265s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:19:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2107cd5e-9b16-4184-9bb7-b18a7cafadbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e7a72b4-6add-41a5-af8c-cd228055a28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:30 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] Volume volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b (733b5c84-d1a6-4bb9-88a8-99b7f8a7136b): created successfully Sep 01 02:19:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e7a72b4-6add-41a5-af8c-cd228055a28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:30 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] Flow 'volume_create_manager' (4d9d7cb5-6f67-4325-b712-829883a03292) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:30 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-a6c79fe7-ff46-4cc9-9170-085265299ac9 tempest-ProjectMemberTests-1927748625 None] Created volume successfully. Sep 01 02:19:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b7a17f82-78c0-46cf-93e2-e353cb8ae773 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b7a17f82-78c0-46cf-93e2-e353cb8ae773 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:30 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-b7a17f82-78c0-46cf-93e2-e353cb8ae773 tempest-ProjectMemberTests-1927748625 None] Creating offline snapshot 16739202-529c-4f2f-8bbe-37999483e380 of volume 733b5c84-d1a6-4bb9-88a8-99b7f8a7136b {{(pid=87128) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:19:30 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bd2f0b-d3d3-4966-aad1-6325ef5ba7f1]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:30 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b7a17f82-78c0-46cf-93e2-e353cb8ae773 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:30 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b Sep 01 02:19:30 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:31 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b7a17f82-78c0-46cf-93e2-e353cb8ae773 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b" returned: 0 in 0.386s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b7a17f82-78c0-46cf-93e2-e353cb8ae773 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b.16739202-529c-4f2f-8bbe-37999483e380 1G {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:31 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b.16739202-529c-4f2f-8bbe-37999483e380 1G Sep 01 02:19:31 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:31 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b7a17f82-78c0-46cf-93e2-e353cb8ae773 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b.16739202-529c-4f2f-8bbe-37999483e380 1G" returned: 0 in 0.440s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b7a17f82-78c0-46cf-93e2-e353cb8ae773 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b.16739202-529c-4f2f-8bbe-37999483e380 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:31 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b.16739202-529c-4f2f-8bbe-37999483e380 Sep 01 02:19:31 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:31 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b7a17f82-78c0-46cf-93e2-e353cb8ae773 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b -F qcow2 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b.16739202-529c-4f2f-8bbe-37999483e380" returned: 0 in 0.303s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:31 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-b7a17f82-78c0-46cf-93e2-e353cb8ae773 tempest-ProjectMemberTests-1927748625 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b.16739202-529c-4f2f-8bbe-37999483e380 is being set with open permissions: ugo+rw Sep 01 02:19:31 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b7a17f82-78c0-46cf-93e2-e353cb8ae773 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b.16739202-529c-4f2f-8bbe-37999483e380 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:31 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b.16739202-529c-4f2f-8bbe-37999483e380 Sep 01 02:19:31 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:32 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b7a17f82-78c0-46cf-93e2-e353cb8ae773 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b.16739202-529c-4f2f-8bbe-37999483e380" returned: 0 in 0.264s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b7a17f82-78c0-46cf-93e2-e353cb8ae773 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:32 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b.info Sep 01 02:19:32 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:32 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b7a17f82-78c0-46cf-93e2-e353cb8ae773 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b.info" returned: 0 in 0.268s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:32 devstack cinder-volume[87128]: WARNING cinder.volume.drivers.remotefs [None req-b7a17f82-78c0-46cf-93e2-e353cb8ae773 tempest-ProjectMemberTests-1927748625 None] /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b.info is being set with open permissions: ugo+rw Sep 01 02:19:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b7a17f82-78c0-46cf-93e2-e353cb8ae773 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b.info {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:32 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b.info Sep 01 02:19:32 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:32 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-b7a17f82-78c0-46cf-93e2-e353cb8ae773 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b.info" returned: 0 in 0.259s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:32 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-b7a17f82-78c0-46cf-93e2-e353cb8ae773 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.002s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:32 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-b7a17f82-78c0-46cf-93e2-e353cb8ae773 tempest-ProjectMemberTests-1927748625 None] Create snapshot completed successfully Sep 01 02:19:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-57950ed0-ed5c-4bf9-8fd8-2f5c4b24dfc4 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-16739202-529c-4f2f-8bbe-37999483e380-delete_snapshot" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-57950ed0-ed5c-4bf9-8fd8-2f5c4b24dfc4 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-16739202-529c-4f2f-8bbe-37999483e380-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-57950ed0-ed5c-4bf9-8fd8-2f5c4b24dfc4 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-quobyte-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b" by "delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-57950ed0-ed5c-4bf9-8fd8-2f5c4b24dfc4 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-57950ed0-ed5c-4bf9-8fd8-2f5c4b24dfc4 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-quobyte-16739202-529c-4f2f-8bbe-37999483e380" by "_delete_snapshot" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:34 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-57950ed0-ed5c-4bf9-8fd8-2f5c4b24dfc4 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-16739202-529c-4f2f-8bbe-37999483e380" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:34 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-57950ed0-ed5c-4bf9-8fd8-2f5c4b24dfc4 tempest-ProjectMemberTests-1927748625 None] Deleting offline snapshot 16739202-529c-4f2f-8bbe-37999483e380 of volume 733b5c84-d1a6-4bb9-88a8-99b7f8a7136b {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:19:34 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-57950ed0-ed5c-4bf9-8fd8-2f5c4b24dfc4 tempest-ProjectMemberTests-1927748625 None] snapshot_file for this snap is: volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b.16739202-529c-4f2f-8bbe-37999483e380 {{(pid=87128) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:19:34 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c86ba2b-27c4-48ed-9a16-3d6d2bb6329d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-57950ed0-ed5c-4bf9-8fd8-2f5c4b24dfc4 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b.16739202-529c-4f2f-8bbe-37999483e380 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:34 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b.16739202-529c-4f2f-8bbe-37999483e380 Sep 01 02:19:34 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:34 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-57950ed0-ed5c-4bf9-8fd8-2f5c4b24dfc4 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b.16739202-529c-4f2f-8bbe-37999483e380" returned: 0 in 0.357s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:34 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-57950ed0-ed5c-4bf9-8fd8-2f5c4b24dfc4 tempest-ProjectMemberTests-1927748625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87128) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:19:34 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1d032b-1830-472f-89f9-d0ac8abc987b]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-57950ed0-ed5c-4bf9-8fd8-2f5c4b24dfc4 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:34 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b Sep 01 02:19:34 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:34 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-57950ed0-ed5c-4bf9-8fd8-2f5c4b24dfc4 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b" returned: 0 in 0.371s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:34 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-57950ed0-ed5c-4bf9-8fd8-2f5c4b24dfc4 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b.16739202-529c-4f2f-8bbe-37999483e380 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:34 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b.16739202-529c-4f2f-8bbe-37999483e380 Sep 01 02:19:34 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:35 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-57950ed0-ed5c-4bf9-8fd8-2f5c4b24dfc4 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b.16739202-529c-4f2f-8bbe-37999483e380" returned: 0 in 0.335s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-57950ed0-ed5c-4bf9-8fd8-2f5c4b24dfc4 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b.16739202-529c-4f2f-8bbe-37999483e380 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:35 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b.16739202-529c-4f2f-8bbe-37999483e380 Sep 01 02:19:35 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:35 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:35 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-57950ed0-ed5c-4bf9-8fd8-2f5c4b24dfc4 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b.16739202-529c-4f2f-8bbe-37999483e380" returned: 0 in 0.283s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-57950ed0-ed5c-4bf9-8fd8-2f5c4b24dfc4 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-16739202-529c-4f2f-8bbe-37999483e380" released by "_delete_snapshot" :: held 1.443s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-57950ed0-ed5c-4bf9-8fd8-2f5c4b24dfc4 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b" released by "delete_snapshot" :: held 1.465s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:35 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-57950ed0-ed5c-4bf9-8fd8-2f5c4b24dfc4 tempest-ProjectMemberTests-1927748625 None] Created reservations ['3af253ba-4d93-4e4b-bba9-b6fe6c7a9ed2', '66c28226-b266-477b-89db-20bb136a5da6', '06d2bc23-db49-4bab-ac27-b4e838ae7cc5', 'd90f7876-6b8c-447a-96a3-1fc30a6316c7'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:35 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-57950ed0-ed5c-4bf9-8fd8-2f5c4b24dfc4 tempest-ProjectMemberTests-1927748625 None] Delete snapshot completed successfully. Sep 01 02:19:35 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-57950ed0-ed5c-4bf9-8fd8-2f5c4b24dfc4 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-16739202-529c-4f2f-8bbe-37999483e380-delete_snapshot" released by "delete_snapshot" :: held 1.610s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-efbe4e82-d457-4ecd-9ae4-45fd8a3cd8f6 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-efbe4e82-d457-4ecd-9ae4-45fd8a3cd8f6 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-efbe4e82-d457-4ecd-9ae4-45fd8a3cd8f6 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "cinder-quobyte-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-efbe4e82-d457-4ecd-9ae4-45fd8a3cd8f6 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b" acquired by "delete_volume" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:36 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[14964177-db1d-41e6-821c-3373727dde19]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-efbe4e82-d457-4ecd-9ae4-45fd8a3cd8f6 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:36 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b Sep 01 02:19:36 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:36 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-efbe4e82-d457-4ecd-9ae4-45fd8a3cd8f6 tempest-ProjectMemberTests-1927748625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b" returned: 0 in 0.361s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-efbe4e82-d457-4ecd-9ae4-45fd8a3cd8f6 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:36 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b Sep 01 02:19:36 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:36 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:36 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-efbe4e82-d457-4ecd-9ae4-45fd8a3cd8f6 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b" returned: 0 in 0.248s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:36 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-efbe4e82-d457-4ecd-9ae4-45fd8a3cd8f6 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-quobyte-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b" released by "delete_volume" :: held 0.669s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:37 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-efbe4e82-d457-4ecd-9ae4-45fd8a3cd8f6 tempest-ProjectMemberTests-1927748625 None] Created reservations ['53552cda-dc31-478a-8bfa-c6216922223f', '04a9b88a-5a42-46c2-9d1e-1fcb2aafb592', 'd468319f-d8cf-48d1-bd84-e3add3c364c8', '726710b5-7d6b-42a5-8cab-b246aa543433'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-efbe4e82-d457-4ecd-9ae4-45fd8a3cd8f6 tempest-ProjectMemberTests-1927748625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-efbe4e82-d457-4ecd-9ae4-45fd8a3cd8f6 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:37 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-efbe4e82-d457-4ecd-9ae4-45fd8a3cd8f6 tempest-ProjectMemberTests-1927748625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:37 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-efbe4e82-d457-4ecd-9ae4-45fd8a3cd8f6 tempest-ProjectMemberTests-1927748625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-efbe4e82-d457-4ecd-9ae4-45fd8a3cd8f6 tempest-ProjectMemberTests-1927748625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-efbe4e82-d457-4ecd-9ae4-45fd8a3cd8f6 tempest-ProjectMemberTests-1927748625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:37 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:19:37 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:37 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:37 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-efbe4e82-d457-4ecd-9ae4-45fd8a3cd8f6 tempest-ProjectMemberTests-1927748625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.258s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:37 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-efbe4e82-d457-4ecd-9ae4-45fd8a3cd8f6 tempest-ProjectMemberTests-1927748625 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:37 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-efbe4e82-d457-4ecd-9ae4-45fd8a3cd8f6 tempest-ProjectMemberTests-1927748625 None] Deleted volume successfully. Sep 01 02:19:37 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-efbe4e82-d457-4ecd-9ae4-45fd8a3cd8f6 tempest-ProjectMemberTests-1927748625 None] Lock "cinder-733b5c84-d1a6-4bb9-88a8-99b7f8a7136b-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:47 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:UPDATE=59,cinder:DELETE=6,cinder:SELECT=41,cinder:INSERT=12 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:19:47 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=40,cinder:UPDATE=48,cinder:INSERT=18,cinder:DELETE=3 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:19:49 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:19:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] Flow 'volume_create_manager' (18adf39b-201d-4056-af22-da8969f92cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e67c0d2-63d2-43b7-9661-06c82aee0109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e67c0d2-63d2-43b7-9661-06c82aee0109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1707687466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd0ddfe3-f208-4693-81e5-d643fd90d68d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2aff9ea73ea49a4b8381c96ba4ab14f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:50Z,use_quota=True,user_id='8128628aacd14a348044546a54ad11de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2c09c2-81c7-441c-a7f2-4b3a72296ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2c09c2-81c7-441c-a7f2-4b3a72296ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547477d9-3995-4832-9b5e-a91578cbb088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547477d9-3995-4832-9b5e-a91578cbb088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd0ddfe3-f208-4693-81e5-d643fd90d68d', 'volume_name': 'volume-fd0ddfe3-f208-4693-81e5-d643fd90d68d', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (783c1435-3a99-41fb-b1d7-5f59b4bcbd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (783c1435-3a99-41fb-b1d7-5f59b4bcbd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:49 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a7a681-f013-4041-9e7b-9d193ebc112b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:49 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] Volume fd0ddfe3-f208-4693-81e5-d643fd90d68d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd0ddfe3-f208-4693-81e5-d643fd90d68d', 'volume_size': 1} Sep 01 02:19:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1707687466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd0ddfe3-f208-4693-81e5-d643fd90d68d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2aff9ea73ea49a4b8381c96ba4ab14f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:50Z,use_quota=True,user_id='8128628aacd14a348044546a54ad11de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:19:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] Creating volume fd0ddfe3-f208-4693-81e5-d643fd90d68d {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:19:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:49 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:19:49 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:19:49 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd0ddfe3-f208-4693-81e5-d643fd90d68d 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:49 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd0ddfe3-f208-4693-81e5-d643fd90d68d 1073741824 Sep 01 02:19:49 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:50 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd0ddfe3-f208-4693-81e5-d643fd90d68d 1073741824" returned: 0 in 0.386s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd0ddfe3-f208-4693-81e5-d643fd90d68d {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:50 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd0ddfe3-f208-4693-81e5-d643fd90d68d Sep 01 02:19:50 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:50 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd0ddfe3-f208-4693-81e5-d643fd90d68d" returned: 0 in 0.226s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:50 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] <== create_volume: return (651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:19:50 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.654s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:50 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a7a681-f013-4041-9e7b-9d193ebc112b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd0ddfe3-f208-4693-81e5-d643fd90d68d', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:50 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df3b45a-1ee7-499d-a6ff-66a811c5b6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:50 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] Volume volume-fd0ddfe3-f208-4693-81e5-d643fd90d68d (fd0ddfe3-f208-4693-81e5-d643fd90d68d): created successfully Sep 01 02:19:50 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df3b45a-1ee7-499d-a6ff-66a811c5b6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:50 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] Flow 'volume_create_manager' (18adf39b-201d-4056-af22-da8969f92cf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:50 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-25eddf03-dab6-40eb-a7af-55fb2f37afb1 tempest-ProjectReaderTests-475188459 None] Created volume successfully. Sep 01 02:19:50 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-06b7f55a-1a6b-43b0-ab08-b2bb0d5c63ee tempest-ProjectReaderTests-475188459 None] Acquiring lock "cinder-fd0ddfe3-f208-4693-81e5-d643fd90d68d-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-06b7f55a-1a6b-43b0-ab08-b2bb0d5c63ee tempest-ProjectReaderTests-475188459 None] Lock "cinder-fd0ddfe3-f208-4693-81e5-d643fd90d68d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-06b7f55a-1a6b-43b0-ab08-b2bb0d5c63ee tempest-ProjectReaderTests-475188459 None] Acquiring lock "cinder-quobyte-fd0ddfe3-f208-4693-81e5-d643fd90d68d" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-06b7f55a-1a6b-43b0-ab08-b2bb0d5c63ee tempest-ProjectReaderTests-475188459 None] Lock "cinder-quobyte-fd0ddfe3-f208-4693-81e5-d643fd90d68d" acquired by "delete_volume" :: waited 0.017s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:51 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40abdf6-fa22-46e7-a3ec-4412fe3e3dac]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-06b7f55a-1a6b-43b0-ab08-b2bb0d5c63ee tempest-ProjectReaderTests-475188459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd0ddfe3-f208-4693-81e5-d643fd90d68d {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:51 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd0ddfe3-f208-4693-81e5-d643fd90d68d Sep 01 02:19:51 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:51 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-06b7f55a-1a6b-43b0-ab08-b2bb0d5c63ee tempest-ProjectReaderTests-475188459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd0ddfe3-f208-4693-81e5-d643fd90d68d" returned: 0 in 0.354s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-06b7f55a-1a6b-43b0-ab08-b2bb0d5c63ee tempest-ProjectReaderTests-475188459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd0ddfe3-f208-4693-81e5-d643fd90d68d {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:51 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd0ddfe3-f208-4693-81e5-d643fd90d68d Sep 01 02:19:51 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:51 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-06b7f55a-1a6b-43b0-ab08-b2bb0d5c63ee tempest-ProjectReaderTests-475188459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-fd0ddfe3-f208-4693-81e5-d643fd90d68d" returned: 0 in 0.229s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:51 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-06b7f55a-1a6b-43b0-ab08-b2bb0d5c63ee tempest-ProjectReaderTests-475188459 None] Lock "cinder-quobyte-fd0ddfe3-f208-4693-81e5-d643fd90d68d" released by "delete_volume" :: held 0.622s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:51 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-06b7f55a-1a6b-43b0-ab08-b2bb0d5c63ee tempest-ProjectReaderTests-475188459 None] Created reservations ['6ad15dc2-4c9c-49d6-b35f-2804b11469ac', '0d03a5e2-1e6a-4fb4-90ca-07893bc716e5', '7d06a2a6-ed0a-443d-8b8d-4d335f90264e', '3f54c9d2-4476-40f2-b229-b688eeddcb9d'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-06b7f55a-1a6b-43b0-ab08-b2bb0d5c63ee tempest-ProjectReaderTests-475188459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-06b7f55a-1a6b-43b0-ab08-b2bb0d5c63ee tempest-ProjectReaderTests-475188459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:51 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-06b7f55a-1a6b-43b0-ab08-b2bb0d5c63ee tempest-ProjectReaderTests-475188459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:51 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-06b7f55a-1a6b-43b0-ab08-b2bb0d5c63ee tempest-ProjectReaderTests-475188459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-06b7f55a-1a6b-43b0-ab08-b2bb0d5c63ee tempest-ProjectReaderTests-475188459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:51 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-06b7f55a-1a6b-43b0-ab08-b2bb0d5c63ee tempest-ProjectReaderTests-475188459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:51 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:19:51 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:52 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-06b7f55a-1a6b-43b0-ab08-b2bb0d5c63ee tempest-ProjectReaderTests-475188459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.258s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:52 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-06b7f55a-1a6b-43b0-ab08-b2bb0d5c63ee tempest-ProjectReaderTests-475188459 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:52 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-06b7f55a-1a6b-43b0-ab08-b2bb0d5c63ee tempest-ProjectReaderTests-475188459 None] Deleted volume successfully. Sep 01 02:19:52 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-06b7f55a-1a6b-43b0-ab08-b2bb0d5c63ee tempest-ProjectReaderTests-475188459 None] Lock "cinder-fd0ddfe3-f208-4693-81e5-d643fd90d68d-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:52 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:19:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] Flow 'volume_create_manager' (f5a0f019-697b-4f7c-a9ac-32bf3a08fc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca672d5e-5f37-44d2-b952-98aad1484db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca672d5e-5f37-44d2-b952-98aad1484db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1452340079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e4669b-b3f9-4542-87f5-21dd5f82f5b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2aff9ea73ea49a4b8381c96ba4ab14f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:53Z,use_quota=True,user_id='8128628aacd14a348044546a54ad11de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a2b2bc-0db6-4edb-a61d-66f92411b82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a2b2bc-0db6-4edb-a61d-66f92411b82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27cac82f-ad71-4df4-bfbc-47b59e0267ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27cac82f-ad71-4df4-bfbc-47b59e0267ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96e4669b-b3f9-4542-87f5-21dd5f82f5b1', 'volume_name': 'volume-96e4669b-b3f9-4542-87f5-21dd5f82f5b1', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04677e0-1a82-401c-9873-9b3b02046010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04677e0-1a82-401c-9873-9b3b02046010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:52 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cbeb837-5206-4f0c-a1fa-ed6ec94165d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:52 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] Volume 96e4669b-b3f9-4542-87f5-21dd5f82f5b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96e4669b-b3f9-4542-87f5-21dd5f82f5b1', 'volume_size': 1} Sep 01 02:19:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:52 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1452340079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e4669b-b3f9-4542-87f5-21dd5f82f5b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2aff9ea73ea49a4b8381c96ba4ab14f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:53Z,use_quota=True,user_id='8128628aacd14a348044546a54ad11de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:19:52 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] Creating volume 96e4669b-b3f9-4542-87f5-21dd5f82f5b1 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:19:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:52 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:52 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:52 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:19:52 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:19:52 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-96e4669b-b3f9-4542-87f5-21dd5f82f5b1 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:52 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-96e4669b-b3f9-4542-87f5-21dd5f82f5b1 1073741824 Sep 01 02:19:52 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:53 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-96e4669b-b3f9-4542-87f5-21dd5f82f5b1 1073741824" returned: 0 in 0.409s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-96e4669b-b3f9-4542-87f5-21dd5f82f5b1 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:53 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-96e4669b-b3f9-4542-87f5-21dd5f82f5b1 Sep 01 02:19:53 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:53 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-96e4669b-b3f9-4542-87f5-21dd5f82f5b1" returned: 0 in 0.231s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:53 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:19:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:53 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cbeb837-5206-4f0c-a1fa-ed6ec94165d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96e4669b-b3f9-4542-87f5-21dd5f82f5b1', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:53 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b1e207-bf26-41ed-adc4-3398995ad551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:53 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] Volume volume-96e4669b-b3f9-4542-87f5-21dd5f82f5b1 (96e4669b-b3f9-4542-87f5-21dd5f82f5b1): created successfully Sep 01 02:19:53 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b1e207-bf26-41ed-adc4-3398995ad551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:53 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] Flow 'volume_create_manager' (f5a0f019-697b-4f7c-a9ac-32bf3a08fc0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:53 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-f4a5fee2-12b2-4e35-8d27-ed718d846803 tempest-ProjectReaderTests-475188459 None] Created volume successfully. Sep 01 02:19:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-451940eb-e493-4820-9d20-7ebf7c85d08e tempest-ProjectReaderTests-475188459 None] Acquiring lock "cinder-96e4669b-b3f9-4542-87f5-21dd5f82f5b1-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-451940eb-e493-4820-9d20-7ebf7c85d08e tempest-ProjectReaderTests-475188459 None] Lock "cinder-96e4669b-b3f9-4542-87f5-21dd5f82f5b1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-451940eb-e493-4820-9d20-7ebf7c85d08e tempest-ProjectReaderTests-475188459 None] Acquiring lock "cinder-quobyte-96e4669b-b3f9-4542-87f5-21dd5f82f5b1" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:53 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-451940eb-e493-4820-9d20-7ebf7c85d08e tempest-ProjectReaderTests-475188459 None] Lock "cinder-quobyte-96e4669b-b3f9-4542-87f5-21dd5f82f5b1" acquired by "delete_volume" :: waited 0.015s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:53 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[10607aa5-6991-446d-a710-27f58ee53f9e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:53 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-451940eb-e493-4820-9d20-7ebf7c85d08e tempest-ProjectReaderTests-475188459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-96e4669b-b3f9-4542-87f5-21dd5f82f5b1 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:53 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-96e4669b-b3f9-4542-87f5-21dd5f82f5b1 Sep 01 02:19:53 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:54 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-451940eb-e493-4820-9d20-7ebf7c85d08e tempest-ProjectReaderTests-475188459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-96e4669b-b3f9-4542-87f5-21dd5f82f5b1" returned: 0 in 0.370s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-451940eb-e493-4820-9d20-7ebf7c85d08e tempest-ProjectReaderTests-475188459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-96e4669b-b3f9-4542-87f5-21dd5f82f5b1 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:54 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-96e4669b-b3f9-4542-87f5-21dd5f82f5b1 Sep 01 02:19:54 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:54 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-451940eb-e493-4820-9d20-7ebf7c85d08e tempest-ProjectReaderTests-475188459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-96e4669b-b3f9-4542-87f5-21dd5f82f5b1" returned: 0 in 0.252s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:54 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-451940eb-e493-4820-9d20-7ebf7c85d08e tempest-ProjectReaderTests-475188459 None] Lock "cinder-quobyte-96e4669b-b3f9-4542-87f5-21dd5f82f5b1" released by "delete_volume" :: held 0.660s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:54 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-451940eb-e493-4820-9d20-7ebf7c85d08e tempest-ProjectReaderTests-475188459 None] Created reservations ['a06b267d-b1df-4df9-99fb-4f0ef9c18183', '01a14199-80bf-4489-b083-00647d6af91a', '29d682f9-5116-497e-ac42-08b012b44542', 'faa86769-2286-4fa5-84ad-af740d0a1821'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-451940eb-e493-4820-9d20-7ebf7c85d08e tempest-ProjectReaderTests-475188459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-451940eb-e493-4820-9d20-7ebf7c85d08e tempest-ProjectReaderTests-475188459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-451940eb-e493-4820-9d20-7ebf7c85d08e tempest-ProjectReaderTests-475188459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:54 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-451940eb-e493-4820-9d20-7ebf7c85d08e tempest-ProjectReaderTests-475188459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-451940eb-e493-4820-9d20-7ebf7c85d08e tempest-ProjectReaderTests-475188459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-451940eb-e493-4820-9d20-7ebf7c85d08e tempest-ProjectReaderTests-475188459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:54 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:19:54 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:54 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:54 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-451940eb-e493-4820-9d20-7ebf7c85d08e tempest-ProjectReaderTests-475188459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.235s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:54 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-451940eb-e493-4820-9d20-7ebf7c85d08e tempest-ProjectReaderTests-475188459 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:54 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-451940eb-e493-4820-9d20-7ebf7c85d08e tempest-ProjectReaderTests-475188459 None] Deleted volume successfully. Sep 01 02:19:54 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-451940eb-e493-4820-9d20-7ebf7c85d08e tempest-ProjectReaderTests-475188459 None] Lock "cinder-96e4669b-b3f9-4542-87f5-21dd5f82f5b1-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:55 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:19:55 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] Flow 'volume_create_manager' (ca728a8d-ed39-4751-bb24-f271fb9fc818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:55 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caf085ee-5c9b-4f00-855b-f5c647ab4cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:55 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caf085ee-5c9b-4f00-855b-f5c647ab4cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1454692877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae25d2bb-c3ba-42c3-8e3e-99b55d93a78d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2aff9ea73ea49a4b8381c96ba4ab14f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:55Z,use_quota=True,user_id='8128628aacd14a348044546a54ad11de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:55 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a82aeb4f-def4-487a-a741-1a401115d736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:55 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a82aeb4f-def4-487a-a741-1a401115d736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:55 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a80c05-5941-4539-9d15-b043b80ba209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:55 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a80c05-5941-4539-9d15-b043b80ba209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae25d2bb-c3ba-42c3-8e3e-99b55d93a78d', 'volume_name': 'volume-ae25d2bb-c3ba-42c3-8e3e-99b55d93a78d', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:55 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bccc1de-5648-4782-ae97-0388ca788c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:55 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bccc1de-5648-4782-ae97-0388ca788c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:55 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4911c19-a825-4e82-a118-00f77e4fda4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:55 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] Volume ae25d2bb-c3ba-42c3-8e3e-99b55d93a78d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae25d2bb-c3ba-42c3-8e3e-99b55d93a78d', 'volume_size': 1} Sep 01 02:19:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:55 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1454692877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae25d2bb-c3ba-42c3-8e3e-99b55d93a78d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2aff9ea73ea49a4b8381c96ba4ab14f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:55Z,use_quota=True,user_id='8128628aacd14a348044546a54ad11de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:19:55 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] Creating volume ae25d2bb-c3ba-42c3-8e3e-99b55d93a78d {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:19:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:55 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:55 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:55 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:19:55 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:19:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae25d2bb-c3ba-42c3-8e3e-99b55d93a78d 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:55 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae25d2bb-c3ba-42c3-8e3e-99b55d93a78d 1073741824 Sep 01 02:19:55 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:55 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae25d2bb-c3ba-42c3-8e3e-99b55d93a78d 1073741824" returned: 0 in 0.417s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:55 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae25d2bb-c3ba-42c3-8e3e-99b55d93a78d {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:55 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae25d2bb-c3ba-42c3-8e3e-99b55d93a78d Sep 01 02:19:55 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:56 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae25d2bb-c3ba-42c3-8e3e-99b55d93a78d" returned: 0 in 0.246s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:56 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:19:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4911c19-a825-4e82-a118-00f77e4fda4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae25d2bb-c3ba-42c3-8e3e-99b55d93a78d', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b17bbaa-8bc0-446f-a34d-3977fb51d77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:56 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] Volume volume-ae25d2bb-c3ba-42c3-8e3e-99b55d93a78d (ae25d2bb-c3ba-42c3-8e3e-99b55d93a78d): created successfully Sep 01 02:19:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b17bbaa-8bc0-446f-a34d-3977fb51d77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:56 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] Flow 'volume_create_manager' (ca728a8d-ed39-4751-bb24-f271fb9fc818) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:56 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-a677a818-778e-4d6f-bbad-e0ebe0015cd7 tempest-ProjectReaderTests-475188459 None] Created volume successfully. Sep 01 02:19:56 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9756bb0b-5b85-4416-b023-cfbfa9155510 tempest-ProjectReaderTests-475188459 None] Acquiring lock "cinder-ae25d2bb-c3ba-42c3-8e3e-99b55d93a78d-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:56 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9756bb0b-5b85-4416-b023-cfbfa9155510 tempest-ProjectReaderTests-475188459 None] Lock "cinder-ae25d2bb-c3ba-42c3-8e3e-99b55d93a78d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:56 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9756bb0b-5b85-4416-b023-cfbfa9155510 tempest-ProjectReaderTests-475188459 None] Acquiring lock "cinder-quobyte-ae25d2bb-c3ba-42c3-8e3e-99b55d93a78d" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:56 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9756bb0b-5b85-4416-b023-cfbfa9155510 tempest-ProjectReaderTests-475188459 None] Lock "cinder-quobyte-ae25d2bb-c3ba-42c3-8e3e-99b55d93a78d" acquired by "delete_volume" :: waited 0.014s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:56 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c9db1b-40d5-4de5-b3be-9a49ec5b0140]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9756bb0b-5b85-4416-b023-cfbfa9155510 tempest-ProjectReaderTests-475188459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae25d2bb-c3ba-42c3-8e3e-99b55d93a78d {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:56 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae25d2bb-c3ba-42c3-8e3e-99b55d93a78d Sep 01 02:19:56 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:56 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9756bb0b-5b85-4416-b023-cfbfa9155510 tempest-ProjectReaderTests-475188459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae25d2bb-c3ba-42c3-8e3e-99b55d93a78d" returned: 0 in 0.358s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:56 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9756bb0b-5b85-4416-b023-cfbfa9155510 tempest-ProjectReaderTests-475188459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae25d2bb-c3ba-42c3-8e3e-99b55d93a78d {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:56 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae25d2bb-c3ba-42c3-8e3e-99b55d93a78d Sep 01 02:19:56 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:57 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9756bb0b-5b85-4416-b023-cfbfa9155510 tempest-ProjectReaderTests-475188459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-ae25d2bb-c3ba-42c3-8e3e-99b55d93a78d" returned: 0 in 0.263s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9756bb0b-5b85-4416-b023-cfbfa9155510 tempest-ProjectReaderTests-475188459 None] Lock "cinder-quobyte-ae25d2bb-c3ba-42c3-8e3e-99b55d93a78d" released by "delete_volume" :: held 0.657s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:57 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-9756bb0b-5b85-4416-b023-cfbfa9155510 tempest-ProjectReaderTests-475188459 None] Created reservations ['3d0f4411-d787-45ba-a29b-b94e3c89dd1e', '8cbb9f72-a42f-4dc0-b94b-843ae539472a', 'cb5d05e5-7f83-4906-9c3a-df858cd8339e', 'ad626267-0835-41a3-ae6d-8f61129ad385'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9756bb0b-5b85-4416-b023-cfbfa9155510 tempest-ProjectReaderTests-475188459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9756bb0b-5b85-4416-b023-cfbfa9155510 tempest-ProjectReaderTests-475188459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-9756bb0b-5b85-4416-b023-cfbfa9155510 tempest-ProjectReaderTests-475188459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:57 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-9756bb0b-5b85-4416-b023-cfbfa9155510 tempest-ProjectReaderTests-475188459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-9756bb0b-5b85-4416-b023-cfbfa9155510 tempest-ProjectReaderTests-475188459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9756bb0b-5b85-4416-b023-cfbfa9155510 tempest-ProjectReaderTests-475188459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:57 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:19:57 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:57 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:57 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-9756bb0b-5b85-4416-b023-cfbfa9155510 tempest-ProjectReaderTests-475188459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.251s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:57 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-9756bb0b-5b85-4416-b023-cfbfa9155510 tempest-ProjectReaderTests-475188459 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:57 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-9756bb0b-5b85-4416-b023-cfbfa9155510 tempest-ProjectReaderTests-475188459 None] Deleted volume successfully. Sep 01 02:19:57 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-9756bb0b-5b85-4416-b023-cfbfa9155510 tempest-ProjectReaderTests-475188459 None] Lock "cinder-ae25d2bb-c3ba-42c3-8e3e-99b55d93a78d-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:57 devstack cinder-volume[87128]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87128) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:19:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] Flow 'volume_create_manager' (7899f141-5677-4960-9e0f-a5ce8ba8e8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb8d110-f272-4aab-8f50-269170e486be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb8d110-f272-4aab-8f50-269170e486be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1751756108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c73be2d-6357-441d-af50-9e21b5fff2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2aff9ea73ea49a4b8381c96ba4ab14f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:58Z,use_quota=True,user_id='8128628aacd14a348044546a54ad11de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d3d9b23-53d9-4db5-a010-7cf77d383063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d3d9b23-53d9-4db5-a010-7cf77d383063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e4d179f-e7ea-4dc4-8c4c-154e3bff759f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:57 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e4d179f-e7ea-4dc4-8c4c-154e3bff759f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c73be2d-6357-441d-af50-9e21b5fff2a7', 'volume_name': 'volume-3c73be2d-6357-441d-af50-9e21b5fff2a7', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9200d23e-e445-4b1f-8968-fd4157bfcebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9200d23e-e445-4b1f-8968-fd4157bfcebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba0cf2d-7246-4412-862b-29808b8019c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:58 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] Volume 3c73be2d-6357-441d-af50-9e21b5fff2a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c73be2d-6357-441d-af50-9e21b5fff2a7', 'volume_size': 1} Sep 01 02:19:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1751756108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c73be2d-6357-441d-af50-9e21b5fff2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2aff9ea73ea49a4b8381c96ba4ab14f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:58Z,use_quota=True,user_id='8128628aacd14a348044546a54ad11de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98040ea9-bad0-44ad-b6d5-9898d92f17a5),volume_type_id=98040ea9-bad0-44ad-b6d5-9898d92f17a5)}" {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:19:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.remotefs [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] Creating volume 3c73be2d-6357-441d-af50-9e21b5fff2a7 {{(pid=87128) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:19:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] Selected osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb as target Quobyte volume. {{(pid=87128) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:19:58 devstack cinder-volume[87128]: INFO cinder.volume.drivers.remotefs [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] casted to osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb Sep 01 02:19:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3c73be2d-6357-441d-af50-9e21b5fff2a7 1073741824 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:58 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3c73be2d-6357-441d-af50-9e21b5fff2a7 1073741824 Sep 01 02:19:58 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:58 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3c73be2d-6357-441d-af50-9e21b5fff2a7 1073741824" returned: 0 in 0.432s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3c73be2d-6357-441d-af50-9e21b5fff2a7 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:58 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3c73be2d-6357-441d-af50-9e21b5fff2a7 Sep 01 02:19:58 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:58 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3c73be2d-6357-441d-af50-9e21b5fff2a7" returned: 0 in 0.240s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:58 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'} {{(pid=87128) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:19:58 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba0cf2d-7246-4412-862b-29808b8019c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c73be2d-6357-441d-af50-9e21b5fff2a7', 'volume_size': 1}' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa2f5bd0-8ab8-48fe-8442-af78f20ee60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:58 devstack cinder-volume[87128]: INFO cinder.volume.flows.manager.create_volume [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] Volume volume-3c73be2d-6357-441d-af50-9e21b5fff2a7 (3c73be2d-6357-441d-af50-9e21b5fff2a7): created successfully Sep 01 02:19:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa2f5bd0-8ab8-48fe-8442-af78f20ee60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87128) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:58 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] Flow 'volume_create_manager' (7899f141-5677-4960-9e0f-a5ce8ba8e8c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87128) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:58 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-cbed5321-53a0-481f-9d6e-ed5022bc352d tempest-ProjectReaderTests-475188459 None] Created volume successfully. Sep 01 02:19:58 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-42eeae9e-168f-41b5-a234-cf9155ce23c1 tempest-ProjectReaderTests-475188459 None] Acquiring lock "cinder-3c73be2d-6357-441d-af50-9e21b5fff2a7-delete_volume" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:58 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-42eeae9e-168f-41b5-a234-cf9155ce23c1 tempest-ProjectReaderTests-475188459 None] Lock "cinder-3c73be2d-6357-441d-af50-9e21b5fff2a7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:59 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-42eeae9e-168f-41b5-a234-cf9155ce23c1 tempest-ProjectReaderTests-475188459 None] Acquiring lock "cinder-quobyte-3c73be2d-6357-441d-af50-9e21b5fff2a7" by "delete_volume" {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:59 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-42eeae9e-168f-41b5-a234-cf9155ce23c1 tempest-ProjectReaderTests-475188459 None] Lock "cinder-quobyte-3c73be2d-6357-441d-af50-9e21b5fff2a7" acquired by "delete_volume" :: waited 0.015s {{(pid=87128) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:59 devstack cinder-volume[87128]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e77538-3f46-48be-8761-fd1861eb2c48]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-42eeae9e-168f-41b5-a234-cf9155ce23c1 tempest-ProjectReaderTests-475188459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3c73be2d-6357-441d-af50-9e21b5fff2a7 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:59 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3c73be2d-6357-441d-af50-9e21b5fff2a7 Sep 01 02:19:59 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:59 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-42eeae9e-168f-41b5-a234-cf9155ce23c1 tempest-ProjectReaderTests-475188459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3c73be2d-6357-441d-af50-9e21b5fff2a7" returned: 0 in 0.364s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-42eeae9e-168f-41b5-a234-cf9155ce23c1 tempest-ProjectReaderTests-475188459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3c73be2d-6357-441d-af50-9e21b5fff2a7 {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:59 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3c73be2d-6357-441d-af50-9e21b5fff2a7 Sep 01 02:19:59 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:59 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-42eeae9e-168f-41b5-a234-cf9155ce23c1 tempest-ProjectReaderTests-475188459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b/volume-3c73be2d-6357-441d-af50-9e21b5fff2a7" returned: 0 in 0.259s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:59 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-42eeae9e-168f-41b5-a234-cf9155ce23c1 tempest-ProjectReaderTests-475188459 None] Lock "cinder-quobyte-3c73be2d-6357-441d-af50-9e21b5fff2a7" released by "delete_volume" :: held 0.667s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:59 devstack cinder-volume[87128]: DEBUG cinder.quota [None req-42eeae9e-168f-41b5-a234-cf9155ce23c1 tempest-ProjectReaderTests-475188459 None] Created reservations ['593e34a3-cf2e-494e-ad1f-bc6365ededfc', '8e34bd23-7772-44db-965f-d61ff682b4f9', 'd75affa7-dad1-49ba-9082-6ff125caa385', '9713fedd-cb0b-43e7-bbdc-c030c1d250c9'] {{(pid=87128) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-42eeae9e-168f-41b5-a234-cf9155ce23c1 tempest-ProjectReaderTests-475188459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-42eeae9e-168f-41b5-a234-cf9155ce23c1 tempest-ProjectReaderTests-475188459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:59 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-42eeae9e-168f-41b5-a234-cf9155ce23c1 tempest-ProjectReaderTests-475188459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:59 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-42eeae9e-168f-41b5-a234-cf9155ce23c1 tempest-ProjectReaderTests-475188459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-42eeae9e-168f-41b5-a234-cf9155ce23c1 tempest-ProjectReaderTests-475188459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:59 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-42eeae9e-168f-41b5-a234-cf9155ce23c1 tempest-ProjectReaderTests-475188459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:59 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:19:59 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:00 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:00 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-42eeae9e-168f-41b5-a234-cf9155ce23c1 tempest-ProjectReaderTests-475188459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.234s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:00 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-42eeae9e-168f-41b5-a234-cf9155ce23c1 tempest-ProjectReaderTests-475188459 None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:00 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-42eeae9e-168f-41b5-a234-cf9155ce23c1 tempest-ProjectReaderTests-475188459 None] Deleted volume successfully. Sep 01 02:20:00 devstack cinder-volume[87128]: DEBUG cinder.coordination [None req-42eeae9e-168f-41b5-a234-cf9155ce23c1 tempest-ProjectReaderTests-475188459 None] Lock "cinder-3c73be2d-6357-441d-af50-9e21b5fff2a7-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=87128) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:09 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:UPDATE=46,cinder:SELECT=34,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:20:10 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=22,cinder:UPDATE=42,cinder:INSERT=13,cinder:DELETE=7 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:20:16 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:20:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb': None} {{(pid=87128) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:16 devstack cinder-volume[87128]: DEBUG cinder.volume.drivers.quobyte [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec5ce4ac-2e9d-48e9-bd08-837d92ab50cb'] {{(pid=87128) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87128) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:16 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:17 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b Sep 01 02:20:17 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:17 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:17 devstack cinder-volume[87128]: DEBUG oslo_concurrency.processutils [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d5b241fcce13b3aa3715c6a7b41560b" returned: 0 in 0.238s {{(pid=87128) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:17 devstack cinder-volume[87128]: DEBUG cinder.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Notifying Schedulers of capabilities ... {{(pid=87128) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:17 devstack cinder-volume[87128]: DEBUG oslo_service.periodic_task [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] Running periodic task VolumeManager._thread_info {{(pid=87128) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:20:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread count: 29 {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:20:17 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-45eeb344-113c-4249-bcfb-65ee6643ccf0 None None] thread info: [<_MainThread(MainThread, started 128688016527488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87128) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}